-- Logs begin at Wed 2022-08-24 05:11:59 UTC, end at Wed 2022-08-24 06:09:42 UTC. -- Aug 24 05:38:26.138719 dv-cinder-854269-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 05:38:26.146291 dv-cinder-854269-1-smb devstack@keystone.service[82386]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:38:26 2022] *** Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: nodename: dv-cinder-854269-1-smb Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: machine: x86_64 Aug 24 05:38:26.148381 dv-cinder-854269-1-smb devstack@keystone.service[82386]: clock source: unix Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: pcre jit disabled Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: detected number of CPU cores: 4 Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: current working directory: / Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: your processes number limit is 47680 Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: your memory page size is 4096 bytes Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: detected max file descriptor number: 2048 Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: lock engine: pthread robust mutexes Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: thunder lock: enabled Aug 24 05:38:26.149261 dv-cinder-854269-1-smb devstack@keystone.service[82386]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 05:38:26.149865 dv-cinder-854269-1-smb devstack@keystone.service[82386]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:38:26.190175 dv-cinder-854269-1-smb devstack@keystone.service[82386]: Python main interpreter initialized at 0x562231fb49c0 Aug 24 05:38:26.190175 dv-cinder-854269-1-smb devstack@keystone.service[82386]: python threads support enabled Aug 24 05:38:26.190175 dv-cinder-854269-1-smb devstack@keystone.service[82386]: your server socket listen backlog is limited to 100 connections Aug 24 05:38:26.190175 dv-cinder-854269-1-smb devstack@keystone.service[82386]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:38:26.190578 dv-cinder-854269-1-smb devstack@keystone.service[82386]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:38:26.190667 dv-cinder-854269-1-smb devstack@keystone.service[82386]: *** Operational MODE: preforking *** Aug 24 05:38:26.190947 dv-cinder-854269-1-smb devstack@keystone.service[82386]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:38:26.190947 dv-cinder-854269-1-smb devstack@keystone.service[82386]: spawned uWSGI master process (pid: 82386) Aug 24 05:38:26.191158 dv-cinder-854269-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 05:38:26.191831 dv-cinder-854269-1-smb devstack@keystone.service[82386]: spawned uWSGI worker 1 (pid: 82399, cores: 1) Aug 24 05:38:26.192161 dv-cinder-854269-1-smb devstack@keystone.service[82386]: spawned uWSGI worker 2 (pid: 82400, cores: 1) Aug 24 05:38:26.197916 dv-cinder-854269-1-smb devstack@keystone.service[82386]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:38:30.530227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:38:30.530227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: from cryptography.utils import int_from_bytes Aug 24 05:38:30.531019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:38:30.531019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: from cryptography.utils import int_from_bytes Aug 24 05:38:30.531138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:38:30.531138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: from cryptography.utils import int_from_bytes Aug 24 05:38:30.531138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:38:30.531138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: from cryptography.utils import int_from_bytes Aug 24 05:38:30.582083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:38:30.582280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:38:30.582451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] command line args: [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:38:30.582722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:38:30.582898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ================================================================================ {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:38:30.583151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] admin_token = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.583401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] config_dir = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.583593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:38:30.583678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.583778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] config_source = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.583860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:38:30.583964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] debug = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.584050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] command line args: [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:38:30.584163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.584429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:38:30.584429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ================================================================================ {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:38:30.584546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.585546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] admin_token = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.585743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.585906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] config_dir = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] config_source = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] debug = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_config_append = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.586917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_dir = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_file = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.587937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_config_append = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_dir = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_file = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.588934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.589978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] publish_errors = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.590996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] standard_threads = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] publish_errors = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.591984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] use_journal = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] use_json = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] use_stderr = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] use_syslog = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] standard_threads = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.592989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.593246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.593522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] use_journal = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.593725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] use_json = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] use_stderr = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.593969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] use_syslog = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.594162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:38:30.594438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.594901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.595873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.596853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.597847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.598999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.599699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600763 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.600992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.601999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.602927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.603838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.604777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.605939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.606955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.607891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.608973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.609962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.610887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.611942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.612891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.613886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.614951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.615885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.616895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.617052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.617126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.617832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.617915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.external = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.618866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.password = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.619992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] auth.token = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.external = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.620942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.password = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] auth.token = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.621928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.622971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.623941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.624915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.625936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.626893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.627864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.628835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.629993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.630955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.631975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.632925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.633517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.633669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.633786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.633945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.634968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.635864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.636961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.637227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.637361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.637492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.637666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.638933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.639854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.640874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.641994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.642918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.643887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.644882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.645829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.646982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.647933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.648991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.649986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.650926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.651870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.652842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.653830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] role.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] role.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] role.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.654961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] role.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.655933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.656903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.657919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.658985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.659965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.660932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.661996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.662978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.663940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.664934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.665916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.666863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.connection = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.667886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.connection = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.668858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.669821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.670872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.671968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.672045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.672209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.672286 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.672364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:38:30.672435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:38:30.672606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:38:30.702907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.703090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.703205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.703289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.703365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.703503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.711879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.712048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.739951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.740174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.740476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.740717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.795486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.795827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.844340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.844567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.845470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:30.845711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.003935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.004519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.027895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.028683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.040075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.040474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.052593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.052785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.052958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.053962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.054097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.054314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:38:31.071144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.071353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:38:31.071434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.071569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:38:31.071699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.071902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:38:31.071996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.072109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:38:31.072187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.072389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.072469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.072657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.072920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.073179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.073257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.073452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.082518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.082802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.083906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.090310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.090907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.093184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.093507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.093820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.093905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.094114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.094945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.095876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.096157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.096235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.096453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.096728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.120081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.120852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.121538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.121848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.122363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.122652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.126515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.126800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.127084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.127506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.127795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.128090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.134002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.134290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.135000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.135291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.138378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.138678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.138966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.139252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.139420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.139537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.139715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.139798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.140854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.141130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.141403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.158113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.158401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.159365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.159650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.162257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.163564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.165504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.165925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.166850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.167153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.170124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.171385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.173239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.174636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.176492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.176794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.177081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.177367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.177648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.177907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.177993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.178216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.178508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.178801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.179088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.179384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.194343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.194627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.194906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.195171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.196516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.196808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.197092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.197370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.202601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.204125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.204294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.204401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.205852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.206144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.207044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.207332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.207624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.207916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.208205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.208790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.209080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.209380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.209677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.209995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.219607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.219887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.220166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.220453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.220736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.221013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.221299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.221512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.221823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.222151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.222451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.222686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.222970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.223261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.237048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.239122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.240103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.242725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.243542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.244983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.245622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.246491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.246778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.247072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.247152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.248558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.248845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.249141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.253527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.255005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.255715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.257183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.258510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.258806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.259095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.259380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.260659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.260952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.261251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.261543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.267581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.267877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.268164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.269635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.269959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.270251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.275097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.275380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.275664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.275942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.276215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.276496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.276769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:38:31.277336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.277914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.278893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.279167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.279452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.279743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.280020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.280295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.280578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.280845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:38:31.313155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562231fb49c0 pid: 82400 (default app) Aug 24 05:38:31.315676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562231fb49c0 pid: 82399 (default app) Aug 24 05:38:31.316537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8601-a859-4972-aed2-c76200ae4e85 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:31.316827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8601-a859-4972-aed2-c76200ae4e85 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:31.317103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8601-a859-4972-aed2-c76200ae4e85 None None] PATH_INFO: `/v3` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:31.321940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Wed Aug 24 05:38:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:37.835827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:37.836303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:37.836303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:37.840649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:38:37.847149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:37.847546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:37.847699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:37.918959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: INFO dbcounter [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] Registered counter for database keystone Aug 24 05:38:37.937514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG oslo_db.sqlalchemy.engines [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:38:37.943612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writer thread running {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:38:38.122528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG passlib.handlers.bcrypt [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82400) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:38:38.122864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG passlib.handlers.bcrypt [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82400) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:38:38.177107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:38.178721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:38.304774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 05:38:38.703335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:38.772002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: INFO dbcounter [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] Registered counter for database keystone Aug 24 05:38:38.793050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG oslo_db.sqlalchemy.engines [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:38:38.799214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writer thread running {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:38:38.919429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710ce4d-323f-4545-b6c7-aca6896e70ec None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:38.923937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:38.924589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:38.924879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:38.925156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:38.933878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:38.984766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:38:38.985113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa30022-a47e-4575-98a5-f2407e2ea300 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:38.995030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Wed Aug 24 05:38:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:38:39.001044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:39.015813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53380f-72d6-4f6a-9e25-9e70bc9a5f40 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:39.020225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:39.021317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:39.021610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:39.021918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] PATH_INFO: `/v3/projects/3d992e7dad954566a305a48a7522cc33` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:39.023473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] RBAC: Authorizing `identity:get_project(project_id=3d992e7dad954566a305a48a7522cc33)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:39.075466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:38:39.075812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc4cf4-032f-452f-b070-59cde4c1c03a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:39.080303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Wed Aug 24 05:38:38 2022] GET /identity/v3/projects/3d992e7dad954566a305a48a7522cc33 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:40.924068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280f94-c68b-407e-8a23-0627ae66c145 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:40.924557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280f94-c68b-407e-8a23-0627ae66c145 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:40.924557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280f94-c68b-407e-8a23-0627ae66c145 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:40.928773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:40.934785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:40.935166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:40.935340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:40.955230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:40.956790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:40.964811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 05:38:41.236955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c280f94-c68b-407e-8a23-0627ae66c145 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:41.249486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c280f94-c68b-407e-8a23-0627ae66c145 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:41.253714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:41.254347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:41.254632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:41.254918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:41.263125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:41.264911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbee304-9c02-43cf-9a5b-8ee3e4e0178a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:41.273551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Wed Aug 24 05:38:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:38:41.278878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:41.288092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65167-27f8-4e7c-a1b4-9cc9d766f991 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:41.292923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:41.293545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:41.293863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:41.294142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:41.295442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:41.297237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd593-d9a7-4649-ba7d-f48032b62ec8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:41.298856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Wed Aug 24 05:38:41 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:43.234669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ce44-b651-417e-bc51-474a7b0f1361 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.235239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ce44-b651-417e-bc51-474a7b0f1361 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.235239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ce44-b651-417e-bc51-474a7b0f1361 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.236599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:43.241874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.242263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.242572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.260193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:43.261366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:43.295310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba953a-2f17-4362-a08d-7ba0c8baab83 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.295611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba953a-2f17-4362-a08d-7ba0c8baab83 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.295892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba953a-2f17-4362-a08d-7ba0c8baab83 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.297317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:38:43.302788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.303079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.303363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.341061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:43.345613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG passlib.handlers.bcrypt [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:38:43.346158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG passlib.handlers.bcrypt [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:38:43.391982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:43.393563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:43.491790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:38:43.606944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:43.630182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:43.712975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8d9e8-373e-4ec7-86f2-f3e34582453c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:43.745514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:43.746124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.746408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.746683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.758235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:43.761382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:43.766945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:43.768022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:38:43.768838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:43.774146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:43.854015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:43.866016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b101b8e-1a84-4fbd-b3d8-95875d39df94 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:43.868285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:43.873289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc86f4-da2c-4aec-93ad-7716762d7462 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:43.905337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:43.906236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.906533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.906811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.907988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:43.908594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:43.908879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:43.909156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:43.909863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:43.910168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:43.911559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:43.922985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:43.928423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:43.974258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:43.975935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.026305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bb703-dbaa-4386-a119-b37a17d81789 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:44.060409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:44.061045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:44.061339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:44.061622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:44.062808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:44.064257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.065846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 9/16] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:43 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:44.071887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:44.076557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 8/17] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:38:44.082900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:44.085724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:44.087183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:44.171850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bb3dc-e6e5-403e-964b-1dec6d6c7a4f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:44.182918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6300-6f13-47ed-b391-bfb4faed3ced None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:44.206298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:44.206944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:44.207235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:44.207519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:44.208644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:44.210228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.211784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:44.217513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:44.218288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:44.219152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:44.219443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:44.219726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:44.238762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:44.240240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:38:44.259188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:44.260185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:38:44.261253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:38:44.261253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:38:44.261253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:38:44.261253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:38:44.266008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:44.298935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:44.318385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3324-6377-4c3d-8e75-ba4d52ea3f34 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:44.322151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:44.353146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:44.353759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:44.354072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:44.354607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:44.355338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.domain.id=default, user.id=8a81889bb63444b2b7591804fdae4c69) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:44.355652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:44.357098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1be7e-0c2f-4384-916c-964311fdc531 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.363600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Wed Aug 24 05:38:44 2022] GET /identity/v3/role_assignments?user.id=8a81889bb63444b2b7591804fdae4c69&scope.domain.id=default&role.id=e815260061204037a403daee014c9531 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:44.368723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce037ba-4a6d-4408-8d20-64b8b171c3d5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:44.404917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:44.405559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:44.405886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:44.406168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:44.406855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:44.407166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:44.408622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6e18f-7bce-4167-b345-98ec9050a364 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:44.430304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:46.784035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908d78-43ea-40bb-a9e6-cfa6e20709cc None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.784555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908d78-43ea-40bb-a9e6-cfa6e20709cc None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.784634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908d78-43ea-40bb-a9e6-cfa6e20709cc None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.786243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:46.799758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24191-303e-433e-8fae-a06cb547356c None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.800716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24191-303e-433e-8fae-a06cb547356c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.801190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24191-303e-433e-8fae-a06cb547356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.827055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-06f24191-303e-433e-8fae-a06cb547356c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:46.828608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-06f24191-303e-433e-8fae-a06cb547356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:46.878985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5ca46-5f01-4a94-ace7-ec30f4ebfc70 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.879593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5ca46-5f01-4a94-ace7-ec30f4ebfc70 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.880065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5ca46-5f01-4a94-ace7-ec30f4ebfc70 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.881601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 13/23] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:46.887247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742b6b-e32a-4123-a4ce-a20eec668035 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.887796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742b6b-e32a-4123-a4ce-a20eec668035 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.888272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742b6b-e32a-4123-a4ce-a20eec668035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.921689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4f742b6b-e32a-4123-a4ce-a20eec668035 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:46.924040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4f742b6b-e32a-4123-a4ce-a20eec668035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:46.965468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 11/24] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:47.041520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 14/25] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:47.076781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8469b5-5300-4e0b-9e6f-13e27fef79a2 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.077438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8469b5-5300-4e0b-9e6f-13e27fef79a2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.077957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8469b5-5300-4e0b-9e6f-13e27fef79a2 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.079773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 12/26] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:47.084695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08ef6-9c97-4b9c-933e-28c0805c61aa None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.085260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08ef6-9c97-4b9c-933e-28c0805c61aa None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.085734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08ef6-9c97-4b9c-933e-28c0805c61aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.114416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-36d08ef6-9c97-4b9c-933e-28c0805c61aa None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:47.116028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-36d08ef6-9c97-4b9c-933e-28c0805c61aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:47.203448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 15/27] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:47.367698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8469b5-5300-4e0b-9e6f-13e27fef79a2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:47.432216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:47.495387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8469b5-5300-4e0b-9e6f-13e27fef79a2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:47.523459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3f52-7911-4b6e-a4a2-2940a7d90b3c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.524081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3f52-7911-4b6e-a4a2-2940a7d90b3c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.524596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3f52-7911-4b6e-a4a2-2940a7d90b3c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.527988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 16/28] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:47.532922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.533437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.533943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.541843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:47.542502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.542791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.543072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.552080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:47.571553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:47.573095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:47.574249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:47.575658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:38:47.596075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:47.596946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:38:47.597707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:38:47.597707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:38:47.597707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:38:47.597707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 13/29] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:47.598405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:47.683772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 17/30] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:38:47.684562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:47.737081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:47.741750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e842d-bc31-4d38-be44-90c980ec3416 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:47.779551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:47.780198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.780489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.780767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.793335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:47.799837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:47.801071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 14/31] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:47.801844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:47.859918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4fff7-59bf-4c3e-8bb9-ba42a3139919 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:47.918530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc60246-eb38-416c-9ba4-4aac470e4751 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:47.919115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:47.920006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.920430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.920935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.921732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:47.922217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:47.923734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:47.925551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:47.947869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 18/32] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:47.948890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:47.966156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:47.966781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:47.967063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:47.967340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:47.968014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:47.969393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a9d43-178b-4541-b2d5-733e29b394ba None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.074887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f436cc-5816-416b-9a47-6bc768edbfbb None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.110953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.111505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 15/33] 10.222.0.61 () {60 vars in 1131 bytes} [Wed Aug 24 05:38:47 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:38:48.112187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.112720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.112963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba72f6-adaf-415c-a70e-9442910997f2 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.113257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba72f6-adaf-415c-a70e-9442910997f2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.113588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba72f6-adaf-415c-a70e-9442910997f2 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.113824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.114727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:48.114848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 16/34] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:48.115377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.117794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.120468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba72f6-adaf-415c-a70e-9442910997f2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.130983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 19/35] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:48.132344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.143015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.198196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.247445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba72f6-adaf-415c-a70e-9442910997f2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.248337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120aa5a-4b45-45ef-90a1-6bbb41cd4dc2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.289456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.290125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.290225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.290422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.290682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.290775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.291032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.291786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.291890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.292210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.293007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b67df1-1514-4367-9f42-fa113f6cfacf None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.293800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e7c96-9682-44ba-b4bd-e32f284467cb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.326907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 17/36] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:38:48.327987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111ee72-6393-40e0-a498-a378dc342f1d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.328285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111ee72-6393-40e0-a498-a378dc342f1d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.328564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111ee72-6393-40e0-a498-a378dc342f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.351864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-4111ee72-6393-40e0-a498-a378dc342f1d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:48.353431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4111ee72-6393-40e0-a498-a378dc342f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:48.418551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 20/37] 10.222.0.61 () {60 vars in 1131 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:38:48.421992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243233c3-56b2-4626-9bf8-8d8c6bd4a821 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.421992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243233c3-56b2-4626-9bf8-8d8c6bd4a821 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.421992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243233c3-56b2-4626-9bf8-8d8c6bd4a821 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.426649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 21/38] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:48.426649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243233c3-56b2-4626-9bf8-8d8c6bd4a821 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.441103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.449459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 18/39] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:48.451718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.452225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.452645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.476511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:48.478263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:48.558966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 19/40] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:48.602879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243233c3-56b2-4626-9bf8-8d8c6bd4a821 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.621145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.643346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.644082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.644445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.645085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.646558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.648269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.650257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 22/41] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:48 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:48.655366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.763126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.764949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd104b-f861-48f0-bd58-c84910ecbfc4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.797320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.804393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.805044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.805336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.805622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.806783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.808235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.810125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 20/42] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:48.815553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.867600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669cc0e-787c-4f42-a71e-4a412a9630b6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.899828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.900436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.900720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.901002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.901676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.903087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.917224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 23/43] 10.222.0.61 () {60 vars in 1131 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/roles => generated 223 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:38:48.918131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:48.919773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f13aa-8f58-4e94-a470-19b9bdf24eac None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:48.968662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:48.969370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.969658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.969971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] PATH_INFO: `/v3/domains/default/users/8a81889bb63444b2b7591804fdae4c69/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.973141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8a81889bb63444b2b7591804fdae4c69, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:48.974655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:48.976002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:48.992554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 21/44] 10.222.0.61 () {58 vars in 1361 bytes} [Wed Aug 24 05:38:48 2022] PUT /identity/v3/domains/default/users/8a81889bb63444b2b7591804fdae4c69/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:38:49.056455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098825a-ee45-4779-b545-89a30f5f270a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:49.098351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:49.099018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:49.099307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:49.099582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:49.101427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:49.102960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03786ff-e348-449c-aef8-91bb836b8311 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:49.105173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 24/45] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:49.111049 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:49.175223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:49.217731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124b80-2eb5-4ac8-bb29-79f85e2502d5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:49.253298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:49.253955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:49.254249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:49.254532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:49.255188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:49.256691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ebbd7-ca32-4acd-b15b-ada603b9a496 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:49.284653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 22/46] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:38:49 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:38:50.903121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02a18-fb9b-4c1f-b57a-61d9be8b9ab0 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:50.903599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02a18-fb9b-4c1f-b57a-61d9be8b9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:50.903599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02a18-fb9b-4c1f-b57a-61d9be8b9ab0 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:50.904971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 25/47] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:50.910401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adf87-e63c-4fe9-917b-5e1609dcecfd None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:50.910829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adf87-e63c-4fe9-917b-5e1609dcecfd None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:50.910975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adf87-e63c-4fe9-917b-5e1609dcecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:50.929105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-392adf87-e63c-4fe9-917b-5e1609dcecfd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:50.930300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-392adf87-e63c-4fe9-917b-5e1609dcecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:50.994854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 23/48] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:51.166409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3efef-de6b-4420-abf2-6f25e1216df1 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.166735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3efef-de6b-4420-abf2-6f25e1216df1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.167124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3efef-de6b-4420-abf2-6f25e1216df1 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.168563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 26/49] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:51.173955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.174248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.174527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.192040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:51.193215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:51.226401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:51.259498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 24/50] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:38:51.260823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3efef-de6b-4420-abf2-6f25e1216df1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:51.466691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3efef-de6b-4420-abf2-6f25e1216df1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:51.479414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:51.500092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:51.500718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.501004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.501281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.511580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:51.516244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:51.517097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:38:51.518045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 27/51] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:51.523111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:51.528356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:51.623567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1274f-fcde-4088-91a5-7648bb5b9936 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:51.626686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a3b12-59bd-4da2-9bfb-1a29992aa776 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:51.658303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:51.658953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.659240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.659519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.660222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:51.660540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:51.661956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:51.664968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:51.665810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.666068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.666345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.667470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:51.668891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:51.670492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 28/52] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:51.674252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 25/53] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:51.675942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:51.681065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:51.721346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:51.784098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918bf0-5263-4cb1-8cd1-3adc0be43689 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:51.818122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:51.820348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:51.820956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.821243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.821666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.822364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:51.823810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:51.851483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 29/54] 10.222.0.61 () {60 vars in 1140 bytes} [Wed Aug 24 05:38:51 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:38:51.893576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179bb8a-c9ac-47af-bd51-56cb106a29af None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:51.930882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:51.931549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.931841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.932139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.933308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:51.934830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:51.936473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 26/55] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:51 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:38:51.942458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:52.036757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:52.047137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c689c9-3699-41ea-8956-08706c0a1735 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:52.081986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:52.082630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:52.082922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:52.083204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:52.084324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:52.085792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98015d-1d32-47a1-8a64-781e9ee3dc6d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:52.087388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 30/56] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:52.093297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:52.188400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:52.191745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6af7-7741-4fcd-8c2f-bd3e098b48b2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:52.224889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:52.226142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:52.226431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:52.226710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:52.227438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.domain.id=default, user.id=8a81889bb63444b2b7591804fdae4c69) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:52.227754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:52.229446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e22be-b651-44dd-b0e6-cae9456e7221 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:52.237621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 27/57] 10.222.0.61 () {56 vars in 1322 bytes} [Wed Aug 24 05:38:52 2022] GET /identity/v3/role_assignments?user.id=8a81889bb63444b2b7591804fdae4c69&scope.domain.id=default&role.id=e815260061204037a403daee014c9531 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:53.773706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0e513-933e-42d5-84ab-4f398d8adb73 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:53.774231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0e513-933e-42d5-84ab-4f398d8adb73 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:53.774313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0e513-933e-42d5-84ab-4f398d8adb73 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:53.775659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 31/58] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:53.780885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74363830-c36b-4018-8a29-89321adad591 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:53.781267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74363830-c36b-4018-8a29-89321adad591 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:53.781458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74363830-c36b-4018-8a29-89321adad591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:53.799524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-74363830-c36b-4018-8a29-89321adad591 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:53.800725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-74363830-c36b-4018-8a29-89321adad591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:53.865889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:54.132224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0e513-933e-42d5-84ab-4f398d8adb73 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:54.231196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0e513-933e-42d5-84ab-4f398d8adb73 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:54.263679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:54.264310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:54.264640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:54.264886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:54.266042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:54.267496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21123-fec2-45c9-9b33-80d8e35a8f2c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:54.269050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 32/60] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:54.275171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74363830-c36b-4018-8a29-89321adad591 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:54.365469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:54.372351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74363830-c36b-4018-8a29-89321adad591 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:54.405912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:54.406469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:54.406759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:54.407043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:54.407704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:54.409154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61e36-42b3-47d1-89f2-809af02f111d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:54.435591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 29/61] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:38:54 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:38:57.421606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b68c-2fd9-4a9f-97d3-5ba1fdf537eb None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.422129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b68c-2fd9-4a9f-97d3-5ba1fdf537eb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.422231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b68c-2fd9-4a9f-97d3-5ba1fdf537eb None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.423562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 33/62] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:57.429386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105163d-3abc-4bf4-9ca7-fce0b4c12364 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.430151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105163d-3abc-4bf4-9ca7-fce0b4c12364 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.430579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105163d-3abc-4bf4-9ca7-fce0b4c12364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.454031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2105163d-3abc-4bf4-9ca7-fce0b4c12364 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:57.455252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2105163d-3abc-4bf4-9ca7-fce0b4c12364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:57.539294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 30/63] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:57.561274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07577-3fa7-473e-b960-bac588d02b64 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.561872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07577-3fa7-473e-b960-bac588d02b64 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.562381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07577-3fa7-473e-b960-bac588d02b64 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.563945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 34/64] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:57.570382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304aa5-0fbe-4cfe-ba90-184f83541608 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.570684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304aa5-0fbe-4cfe-ba90-184f83541608 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.570965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304aa5-0fbe-4cfe-ba90-184f83541608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.598734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bd304aa5-0fbe-4cfe-ba90-184f83541608 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:57.600489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bd304aa5-0fbe-4cfe-ba90-184f83541608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:57.661457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773319-e63d-4812-a092-7ba930c2e440 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.662104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773319-e63d-4812-a092-7ba930c2e440 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.663152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773319-e63d-4812-a092-7ba930c2e440 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.664716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 35/65] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:38:57.669846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.670367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.670856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.689636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:57.691478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:57.699101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 31/66] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:57.738137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:57.815196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 36/67] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:38:57.854660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61cbf-1730-4f52-9952-9581e2f71801 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.855340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61cbf-1730-4f52-9952-9581e2f71801 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.855844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61cbf-1730-4f52-9952-9581e2f71801 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.857394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 32/68] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:57.858531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:57.862898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:57.863444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:57.863948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:57.883574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:57.885373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:57.889328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:57.964347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 33/69] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:38:58.038541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77314a-9fc2-42b0-bb0c-d7b847e16d9c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.052305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.086836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.087485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.087778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.088063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.111516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:58.116882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:58.117683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:38:58.118435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 37/70] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:38:58.130373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.168080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.234546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e31e6-c73a-4636-881d-252f7b2d915d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.258235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d773333-256a-4684-b17f-ecf0e5458b48 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.278231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.278878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.279165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.279443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.287194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.291029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:58.295916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e200e-b32d-468f-b846-288660a699be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:58.296153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:58.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:38:58.298035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:38:58.299258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e200e-b32d-468f-b846-288660a699be None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.299554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e200e-b32d-468f-b846-288660a699be None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.299653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 34/71] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:38:58.299833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e200e-b32d-468f-b846-288660a699be None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.300514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e200e-b32d-468f-b846-288660a699be None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:58.300623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.300825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e200e-b32d-468f-b846-288660a699be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.302234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e200e-b32d-468f-b846-288660a699be None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.311902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 38/72] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.312896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e200e-b32d-468f-b846-288660a699be None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.393598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.405212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272323-468c-4db8-812e-ed62a63d9996 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.415832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e200e-b32d-468f-b846-288660a699be None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.440065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.440697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.440988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.441274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.448902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.449539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.449855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.450373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.452783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:58.457611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:58.458515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:38:58.459795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 35/73] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:58.460409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.462566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:38:58.468241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:38:58.469074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:38:58.469870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 39/74] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:38:58.470486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.521130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.562376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c3148-36d2-4465-b2d7-ae63ab16249d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.575269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da84-74df-4ce6-bb18-a6767c9b0add None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.597350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.597985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.598270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.598547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.599222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:58.599527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.600947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34a815-cb0c-4d91-9b79-f2fdd8fa2009 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.609025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 36/75] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.613927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.614058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1146e-c8fc-4dee-ba5d-6e0f005ba92f None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.614058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1146e-c8fc-4dee-ba5d-6e0f005ba92f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.614191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.614257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1146e-c8fc-4dee-ba5d-6e0f005ba92f None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.614319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.614319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.614439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 37/76] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:38:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:58.614501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1146e-c8fc-4dee-ba5d-6e0f005ba92f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.623310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.627226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.629198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.631593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 40/77] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.632248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.719262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1146e-c8fc-4dee-ba5d-6e0f005ba92f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.731717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8710-1992-47fb-9bb7-16f892d1dc08 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.741268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.753023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.753636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.753955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.754236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.754901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:58.755215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.757196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.765466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 38/78] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.766095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.766444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.767006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.767384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.767673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.768357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:38:58.768670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.770161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a04e1-24ee-4b63-8030-a412ee6f82f5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.779192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 41/79] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.780465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.780770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.781054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.798052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:58.799250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:58.853821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.864655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 42/80] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:38:58.877986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.883406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2907-3dc8-404e-a086-9cd18dc0f2ec None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.918821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:58.919463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.919758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.920048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.921258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:58.922746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:58.924350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 39/81] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:58.925113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.975016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02900f-d968-43a9-b449-35a1763c78b4 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:58.979431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.012135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.013119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.013619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.014119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.029147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450af50-6f40-4cc3-bf9d-b5c75c35ba3f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.064432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.065001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.065290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.065568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.066768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.068211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.070622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 40/82] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.071188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.080980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.093533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.095159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.174618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0e1c-4098-4f63-b014-5e8b50c65440 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.195269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.196381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 43/83] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:59.197237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.209529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.210204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.210493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.210781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.211915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.213379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.219671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 41/84] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.219671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.288316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.299101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1ff8-3d8c-4074-8fe2-f0adc7b0eade None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.317945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cede7-b22b-46b3-9294-b299aed10ff9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.332780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.333386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.333674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.333979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.351674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.352358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.352649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.353206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.401820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.403287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.407210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.421577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.423080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.491289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.502535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 44/85] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:59.507129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.523231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:59.524556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.607955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.609991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371671e-e4ef-4056-bcf7-b761409fb0bb None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.620790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780b0c-8b85-4f37-9ff2-8751c034a7bc None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.644463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.645089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.645376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.645656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.647327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.648773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.650544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 45/87] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.651120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.658724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.659438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.659726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.660060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.661603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.663092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.664854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 43/88] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.665459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.711248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.752522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595304-cf49-4e95-90f9-02cf401137c9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.764429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1516-b5e9-47ac-9ab3-5896a45f00df None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.785883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.786498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.786787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.787069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.797158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.797825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.798118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.798402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.799529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.801368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.803716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 44/89] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.804437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.829549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.860387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.861829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.904947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc201-772d-465b-8733-7788d1039df4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.938190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.938822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.939106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.939384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.940490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.941979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.944165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 45/90] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:38:59.944916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:59.964956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 46/91] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:59.965820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.035185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:00.044359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad1f7-537a-4df2-be0a-4a91cf6dc07d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.063993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443c4f-1d2d-4187-ae28-011a8e88b11e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.077688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.078324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.078617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.078903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.079556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.081012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.097283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.097927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.098219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.098501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.099239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:00.099555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.101520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.105821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 46/92] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:38:59 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:00.105821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.117886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 47/93] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:38:59 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:00.117886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.142063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:00.245928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5573c-87c7-4569-b5a9-2abc3d678e4f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.290780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca09-866a-4dc0-98d6-11ff170aed56 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.291975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.292605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.292895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.293177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.293945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:00.294259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.295720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.305417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 48/94] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:00 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:00.306502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.346854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.347625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.347980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.348332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.349503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=8a81889bb63444b2b7591804fdae4c69) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:00.350965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.352919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.361807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 47/95] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:00 2022] GET /identity/v3/role_assignments?user.id=8a81889bb63444b2b7591804fdae4c69&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:00.423124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:00.441973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b3a32-368b-4b97-bd6b-a2bc2be3b25c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.487966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.488978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.489458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.489978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] PATH_INFO: `/v3/projects/f10fe5ae14cc4348af9234def73b22d1` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.492634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] RBAC: Authorizing `identity:get_project(project_id=f10fe5ae14cc4348af9234def73b22d1)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.494914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2ca0-7c62-408c-b3ec-ad5c82a2a25b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.497231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 49/96] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:00 2022] GET /identity/v3/projects/f10fe5ae14cc4348af9234def73b22d1 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:00.504832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.524797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:00.635776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece3b4-d2ec-4c29-8438-b6db9963e3ab None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:00.678629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:00.679177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.679464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.679742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.680479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=f10fe5ae14cc4348af9234def73b22d1, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:00.680791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:00.682296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1ba11-ee8f-40ac-9162-05da3e5adc6f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:00.690469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 48/97] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:00 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=f10fe5ae14cc4348af9234def73b22d1&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:02.800253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf6f-6149-48ed-a44d-7e66eeed9f1c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:02.801272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf6f-6149-48ed-a44d-7e66eeed9f1c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:02.801754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf6f-6149-48ed-a44d-7e66eeed9f1c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:02.803945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 50/98] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:02.809425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece108-f0c1-4035-9ba3-8ea7e861f725 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:02.809881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece108-f0c1-4035-9ba3-8ea7e861f725 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:02.810016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece108-f0c1-4035-9ba3-8ea7e861f725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:02.834806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f9ece108-f0c1-4035-9ba3-8ea7e861f725 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:02.836237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f9ece108-f0c1-4035-9ba3-8ea7e861f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:02.866657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a937-64ad-4681-96b2-fe0f43a6bcd5 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:02.867288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a937-64ad-4681-96b2-fe0f43a6bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:02.867780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a937-64ad-4681-96b2-fe0f43a6bcd5 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:02.869310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 51/99] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:02.874621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ae95-ef90-497f-989e-b20a0ef86dc5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:02.875165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ae95-ef90-497f-989e-b20a0ef86dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:02.875668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ae95-ef90-497f-989e-b20a0ef86dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:02.902182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4d61ae95-ef90-497f-989e-b20a0ef86dc5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:02.903776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4d61ae95-ef90-497f-989e-b20a0ef86dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:02.912056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 49/100] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:03.008631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 52/101] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:03.018065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1add3-c343-4d6f-9e77-532fc24e394c None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.018599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1add3-c343-4d6f-9e77-532fc24e394c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.019150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1add3-c343-4d6f-9e77-532fc24e394c None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.020706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 50/102] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:03.026017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.026545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.027046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.047915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa0af-f009-4b10-b6a1-d8b5d06e6d17 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.048572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa0af-f009-4b10-b6a1-d8b5d06e6d17 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.049045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa0af-f009-4b10-b6a1-d8b5d06e6d17 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.049214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:03.050420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:03.051095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 51/103] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:03.058847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.059377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.059893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.082129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.100762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:03.102007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:03.164841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 53/104] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:03.221382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 52/105] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:03.333742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.355368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.360731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.476819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da824d-3bfc-4ccc-a058-3a667f68374b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.498818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6931-3530-4464-8d6c-5424a49dac53 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.514618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.514618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.514618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.514618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.526316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:03.531336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:03.532196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:03.532920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 53/106] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:03.533518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.546136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.568916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.572600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.572600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.578165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.597237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:03.610561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:03.611390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:03.612120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 54/107] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:03.612734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.642646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302024-561b-44d0-a34e-b4f604f1ea62 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.685852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.686663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.687167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.687454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.688636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:03.690215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:03.692227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 54/108] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:03.693074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.729646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.757135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bfa45-195c-4554-8207-84d1972daded None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.759820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.793605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.794259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.794545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.794827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.795510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:03.795821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:03.797209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4cd92-60ba-4874-8197-52d6a1e9f906 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:03.800561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43a0a-d583-426c-82b6-d4a6cebc0ff9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.806524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 55/109] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:03.807560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943133-0e7a-4254-ac14-b3fcd67eefb3 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.807849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943133-0e7a-4254-ac14-b3fcd67eefb3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.808131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943133-0e7a-4254-ac14-b3fcd67eefb3 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.810634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 56/110] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:03.811354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f943133-0e7a-4254-ac14-b3fcd67eefb3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.843254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.844571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.845056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.845532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.846446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:03.846930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:03.848720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:03.859599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 55/111] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:03.860517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:03.931517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f943133-0e7a-4254-ac14-b3fcd67eefb3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.965164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536ec34-37ae-472b-90f3-d504d1c8c0f1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:03.968639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:03.969262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:03.969600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:03.969922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:03.970576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:03.972129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:03.977753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:03.991734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.001185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.001429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 57/112] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:39:03 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:04.001856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.002145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.002427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.007207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.014294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-bc8faec6-6d78-4956-98f9-def0111e7389 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:04.019710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:04.020853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:04.022225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 56/113] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:04.022821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.023002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.023280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.042720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:04.043952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:04.119027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 57/114] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:04.120607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.139115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8a80-0f81-4b75-86f0-fc8820674fa5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.180891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.181542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.181934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.182214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.183371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.184815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33295-ef8e-4c4a-b79b-94635193c262 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.186605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 58/115] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:04.187764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94308466-659c-4a5a-9a54-0e516511d2e8 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.188061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94308466-659c-4a5a-9a54-0e516511d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.188395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94308466-659c-4a5a-9a54-0e516511d2e8 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.189865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 59/116] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:04.190585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94308466-659c-4a5a-9a54-0e516511d2e8 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.235527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b3277-e190-416f-8ee2-91369a7c17b8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.259758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.261782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.283578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.284606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.284899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.285486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] PATH_INFO: `/v3/users/2887ae5af6f44fbb91f4fb4f075618f0` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.305722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] RBAC: Authorizing `identity:get_user(user_id=2887ae5af6f44fbb91f4fb4f075618f0)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.307713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.309488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94308466-659c-4a5a-9a54-0e516511d2e8 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.309985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 58/117] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/users/2887ae5af6f44fbb91f4fb4f075618f0 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:04.310620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.350750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.351375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.351667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.351952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.352630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:04.352943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.354638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139117-4877-4ebf-b63c-3349b22d8d60 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.367700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 60/118] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:04.370567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.370809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.371099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.395168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:04.396400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:04.442967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562d6a-a75a-4b7b-851f-9f8c36c96a62 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.477791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 61/119] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:04.477791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.489133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.490729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.491088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.491715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.492997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.495288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.497443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 59/120] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:04.499232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.538627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.559255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.601596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572a649-e83a-4913-877d-4670693e1b4c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.628442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de284-1400-4a9c-86aa-83583fcb06b9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.639992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.640930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.641468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.642011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.668906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.669541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.669994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.670400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.671568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.673654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.675534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 60/121] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:04.676680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.725638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.727475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.779615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.803704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82069-0727-44b2-8826-4e85ba40cb1e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.814983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.833387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 62/122] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:04.838356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.845244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.845923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.846571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.846874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.858121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:04.862910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:04.863726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:04.864450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 61/123] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:04.865095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.944195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c108a-dfec-46ff-8c92-053539370d99 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.970885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c222d5-c235-4891-a378-26f1fb24eca8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.978067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.979001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.979289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.979576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/users/5f6e22c993174f38bce5d39110d85361/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.981546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, user_id=5f6e22c993174f38bce5d39110d85361, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.983034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.996642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 63/124] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:04 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/users/5f6e22c993174f38bce5d39110d85361/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:04.997448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.015576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.019489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.020568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.020871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.021863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.023623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.025321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.027337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 62/125] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.028165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.079868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.139795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae90f-e9a1-4149-a783-7033b7ff4fa6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.155503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2056e3-5e3e-45b4-ab4a-1577a6ae8b2d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.180579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.181605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.182138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.182619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.195175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:05.197730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.198427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.198715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.198996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.200838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:05.202119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:05.202926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:05.203704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:05.204774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.204774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 63/126] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.204774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.206613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 64/127] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:05.207790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.298685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.327212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d496f3-fad5-4298-83d5-20f7c542a93a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.335215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.344467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bfbee-0381-481d-a312-8a366ddcf409 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.374227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.375412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.376273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.377024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.378193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:05.378677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.381500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.387833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.388582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.389305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.389305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/users/5f6e22c993174f38bce5d39110d85361/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.391644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, user_id=5f6e22c993174f38bce5d39110d85361, role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.393174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.393418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 64/128] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.394459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.411058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 65/129] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:05 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/users/5f6e22c993174f38bce5d39110d85361/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:05.411913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.522856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694b77-23a7-4450-97b1-9b1e6321f05a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.557404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42d56-2d09-442f-89ec-ee5531379697 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.590485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.591190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.591483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.591762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.592522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=2887ae5af6f44fbb91f4fb4f075618f0) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:05.592837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.594377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.609989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 65/130] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/role_assignments?user.id=2887ae5af6f44fbb91f4fb4f075618f0&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.611346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.632939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.659294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.659971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.660265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.660556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.661305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:05.662050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.663714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.678409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.678770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 66/131] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.686008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.777608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a85c-fa88-4757-adfd-6fa7926ee2ce None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.833358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:05.834211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:05.834511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:05.834794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:05.835984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:05.837622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:05.839375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 66/132] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:05.845946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:05.928477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99e5b-f484-4379-a281-088d1ed83521 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:05.994147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:05.997112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a08a2-7257-4bf2-855a-67ba677fe6db None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:06.054599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:06.055182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.055479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.055762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.057068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:06.058561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:06.060489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:06.061147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.061436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.061717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.061848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 67/133] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:06.062883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:06.064332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:06.070425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 67/134] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:05 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:06.071664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:06.076037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:06.185527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:06.277671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b1ad-90f4-4dd7-afa0-ff4c95a6461e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:06.299817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba02b0-5785-429c-a43c-e6de12f19c9f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:06.346730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:06.347320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.347611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.347897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] PATH_INFO: `/v3/projects/f10fe5ae14cc4348af9234def73b22d1` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.349968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=f10fe5ae14cc4348af9234def73b22d1)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:06.351465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d547b-8d9f-4a09-87ed-057cccfae5d9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:06.353465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 68/135] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:06 2022] GET /identity/v3/projects/f10fe5ae14cc4348af9234def73b22d1 => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:06.360913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55cdc-10fc-4910-af27-42b92a574189 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.361204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55cdc-10fc-4910-af27-42b92a574189 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.361489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55cdc-10fc-4910-af27-42b92a574189 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.363112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 69/136] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:06.366414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed55cdc-10fc-4910-af27-42b92a574189 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:06.369065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:06.369744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.370059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.370394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/users/8a81889bb63444b2b7591804fdae4c69/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.374264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, user_id=8a81889bb63444b2b7591804fdae4c69, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:06.375714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7cab0-786b-4e10-94c4-63441e76a846 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:06.405028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 68/137] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:06 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/users/8a81889bb63444b2b7591804fdae4c69/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:06.406672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.406976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.407267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.437240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:06.438878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:06.464965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:06.540481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 69/138] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:06.562900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed55cdc-10fc-4910-af27-42b92a574189 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:06.594769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:06.607248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:06.607907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.608199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.608486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] PATH_INFO: `/v3/projects/f10fe5ae14cc4348af9234def73b22d1/users/5f6e22c993174f38bce5d39110d85361/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.612109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] RBAC: Authorizing `identity:create_grant(project_id=f10fe5ae14cc4348af9234def73b22d1, user_id=5f6e22c993174f38bce5d39110d85361, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:06.613632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:06.639320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 70/139] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:06 2022] PUT /identity/v3/projects/f10fe5ae14cc4348af9234def73b22d1/users/5f6e22c993174f38bce5d39110d85361/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:06.986501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:07.111932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d3a6c-f16b-4800-95bc-574cc1a5b0af None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:07.155335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:07.155986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:07.156371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:07.156653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:07.160714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:07.162880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6821d4-b0ea-4d56-a40d-ef3b6369462d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:07.164568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 70/140] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:07.170300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:07.280491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa37ce0-18be-4053-9866-98af781d5898 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:07.321918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:07.322551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:07.322846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:07.323129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:07.323809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:07.325274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c13968-785d-4a3c-90df-9b00dcacc791 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:07.372885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 71/141] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:07 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:07.951831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b62d6-981d-4290-be8a-7dacca8e4424 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:07.952168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b62d6-981d-4290-be8a-7dacca8e4424 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:07.952351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b62d6-981d-4290-be8a-7dacca8e4424 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:07.953703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 71/142] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:07.960054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe219d9-b90a-48db-a19d-b4a50217766d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:07.960360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe219d9-b90a-48db-a19d-b4a50217766d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:07.960648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe219d9-b90a-48db-a19d-b4a50217766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:07.989934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8fe219d9-b90a-48db-a19d-b4a50217766d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:07.991207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8fe219d9-b90a-48db-a19d-b4a50217766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:08.038378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:08.084974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 72/143] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:08.134563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6433-264b-4970-8b20-4b4f44950907 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.135070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6433-264b-4970-8b20-4b4f44950907 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.135151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6433-264b-4970-8b20-4b4f44950907 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.136476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 72/144] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:08.142092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.142396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.142684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.166742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:08.168004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:08.180813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bdc7d-d6cf-4c3e-8bf3-8dffe5f20ff3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.181111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bdc7d-d6cf-4c3e-8bf3-8dffe5f20ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.181417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bdc7d-d6cf-4c3e-8bf3-8dffe5f20ff3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.182954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 73/145] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:08.192388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.192679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.193553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.229116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:08.230273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:08.247435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 73/146] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:08.269858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:08.337323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 74/147] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 05:39:08.478382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:08.607378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:08.611760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b66c9-14ff-4284-bc64-a5933621b5cc None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:08.613382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:08.655112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:08.655930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.656428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.656810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.669984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:08.675146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:08.676067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:08.676786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 74/148] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:08.683482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:08.821111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df106-13ad-4835-85f2-3ca9c652b6d9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:08.844016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877a232-db59-44e2-b100-38b616f1fa88 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:08.887863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:08.888865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.889351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.889893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.890686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:08.891097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:08.893911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:08.903115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 75/149] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:08.906280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:08.906835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:08.908057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:08.908545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:08.909101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:08.938788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:08.939716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:08.947386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:08.948251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:08.948991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:08.952471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 75/150] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:08.953305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.001477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.066606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec861874-108c-4e0b-8add-e0152cbb9490 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.115167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.115739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.116022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.116300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.129795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:09.136862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:09.137704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:09.138466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:09.139150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 76/151] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:09.139770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.147417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62945-9804-4283-8bcb-5fd0b0ab9a27 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.196517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.197193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.197901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.198190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.199784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.202093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db24df7-0920-449e-b828-556b742f8aae None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.204198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 76/152] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:08 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.205464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a7e7-a25e-4f1f-b5be-a8ac6871a55a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.205752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a7e7-a25e-4f1f-b5be-a8ac6871a55a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.206038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a7e7-a25e-4f1f-b5be-a8ac6871a55a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.207266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 77/153] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:09.207982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a7e7-a25e-4f1f-b5be-a8ac6871a55a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.262812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.286407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a8d4-1871-435e-a0fe-0b8a7e2a1b04 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.322951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.333212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.334419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.334703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.334980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.335757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:09.336071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.337581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.343942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a7e7-a25e-4f1f-b5be-a8ac6871a55a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.346937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 77/154] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.347771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.382980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.383580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.383868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.384150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.384989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:09.385299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.386879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecc014-8f09-4b3c-a249-07c28d8eae31 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.396759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 78/155] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.398452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.398751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.399030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.418882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:09.420202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:09.456412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa64e-5ffa-4fd6-a143-888a0c7cab7d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.493219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.493972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.494251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.494530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.501570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 79/156] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:09.502530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.512351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.569469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.571153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.635087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.668940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcf22c-e430-471a-a084-335941e3c4b8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.680592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 78/157] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:09.681371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.728429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.729082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.729370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.729649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.730851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.732309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.732465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:09.734206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 80/158] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.734797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.808300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5ecf-ef71-44ed-8b75-44974dce1da1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.865890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.866556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.866843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.867263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] PATH_INFO: `/v3/users/2887ae5af6f44fbb91f4fb4f075618f0` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.868543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] RBAC: Authorizing `identity:get_user(user_id=2887ae5af6f44fbb91f4fb4f075618f0)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.870760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6769-aa9d-4275-905d-4df875b341b9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:09.874632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.878096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 79/159] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/users/2887ae5af6f44fbb91f4fb4f075618f0 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.879368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.928071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:09.928649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.928930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.929253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.930545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:09.932082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:09.933973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 81/160] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:09.934594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:09.963841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.060817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9daed9-08af-48c3-9cfe-1063acdbfa1a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.084348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.122388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.123290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.123582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.123863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.171483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047e3f9-83ee-43c5-ac36-400e72e7aa44 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.207930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.208931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.209962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.210439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.212032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.214643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.217175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 82/161] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:10.218411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.227536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.229449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d31e2-984c-4a77-9a96-aec8d8ca8e8a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.347342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 80/162] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:10.349983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82ed2-9d22-4159-b3e6-820b64cc5404 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.350482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82ed2-9d22-4159-b3e6-820b64cc5404 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.350954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e82ed2-9d22-4159-b3e6-820b64cc5404 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.351499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.353483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 81/163] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:10.354611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e82ed2-9d22-4159-b3e6-820b64cc5404 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.372505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.402655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bfa8c-b5a5-4888-8df2-77ed2816f9bd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.470342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e82ed2-9d22-4159-b3e6-820b64cc5404 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.492891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.493721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.494193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.494608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.495487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:10.495935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.497532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.509955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 83/164] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:10.510751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.515147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.515807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.516089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.516361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.542384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:10.552485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:10.553390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 82/165] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:10.554648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.657583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.675959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa8a30-f4e0-4b83-af8c-fe95c1d05ad6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.715931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.716625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.716914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.717199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.718443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.719939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adadca-f446-45e7-8056-1fb91d34cc63 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.721951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 83/166] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:10.723584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.723875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.724723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.748213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:10.749415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:10.783227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8354b-7bb1-4f4e-8010-a48a53da6f09 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.826760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.828028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.828314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.828901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/users/2887ae5af6f44fbb91f4fb4f075618f0/roles/dd4e548ecfaf4724a4a04743f167d3a7` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.831594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, user_id=2887ae5af6f44fbb91f4fb4f075618f0, role_id=dd4e548ecfaf4724a4a04743f167d3a7)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.833324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.845013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 84/167] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:10.845756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.855454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 84/168] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:10 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/users/2887ae5af6f44fbb91f4fb4f075618f0/roles/dd4e548ecfaf4724a4a04743f167d3a7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:10.856220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.861726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.947307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.988859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c462-2e19-4d1f-bdff-c58b2bc0c4fd None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.997183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3b092-670a-43e4-9a1c-fec2ea65c5e4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.039493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.040240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.040526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.041056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.042201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:11.042665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:11.044398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:11.047052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.047753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.048163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.048510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.049329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:11.049715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:11.051423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:11.053826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 85/169] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:11.061256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:11.063254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 85/170] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:11.177055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876938-ac7a-4a97-abfb-eba69a5ac4ad None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.229407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.230098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.230382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.230663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] PATH_INFO: `/v3/users/8a81889bb63444b2b7591804fdae4c69` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.231832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] RBAC: Authorizing `identity:get_user(user_id=8a81889bb63444b2b7591804fdae4c69)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:11.233288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770ae22-2fc7-47a0-b36a-412ca0a4cfdf None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:11.235238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 86/171] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/users/8a81889bb63444b2b7591804fdae4c69 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:11.241249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:11.332856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980757aa-62e8-4c8b-ae48-27ee552e8373 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.333148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980757aa-62e8-4c8b-ae48-27ee552e8373 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.333465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980757aa-62e8-4c8b-ae48-27ee552e8373 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.335004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 87/172] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:11.340677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.341274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.341719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.345562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:11.360282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:11.382881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:11.384088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:11.399478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2882-05f5-44c3-8693-f16834dc8065 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.459661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.460288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.460626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.460902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.511397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 88/173] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:11.512528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:11.603153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:11.604675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:11.628621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001abf69-32e9-49bc-b4ca-ae98ec0a3f65 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.678150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:11.681034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.681694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.682168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.682456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.703803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:11.709686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:11.710713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:11.711566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:11.716621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 89/174] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:11.727728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:11.738321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:11.807133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 86/175] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:11.827477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:11.928906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed610cf-9454-46c3-80ad-ed02d0df8b3a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.964005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f42fe-fee5-4186-af8e-98ff5d7c3e34 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:11.970382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:11.971220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:11.971655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:11.972080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:11.972910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:11.973363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:11.975609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:11.985149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 90/176] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:11.986197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.002208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.002828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.003113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.003390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.004524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.006577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.008557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 87/177] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:12.009335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.045406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.053645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.101890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998d59-70ec-4807-b642-fd4a49b24793 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.116512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec531-9386-4af9-9dfe-8544dfc5c220 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.139403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.140307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.140737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.141160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.152316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:12.153794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.154444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.154730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.155011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] PATH_INFO: `/v3/users/5f6e22c993174f38bce5d39110d85361` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.156143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6e22c993174f38bce5d39110d85361)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.157849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2cef5-ddb7-497e-b302-e2ed60794214 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:12.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:12.159786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:12.160696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 91/178] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:12.161309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.162661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 88/179] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/users/5f6e22c993174f38bce5d39110d85361 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:12.164088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ee0a-e1e2-4c8b-ae91-716c2307f7c9 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.164572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ee0a-e1e2-4c8b-ae91-716c2307f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.165043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ee0a-e1e2-4c8b-ae91-716c2307f7c9 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.166477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 89/180] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:12.173811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.173811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.176760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.196130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:12.197868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:12.278238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caa1-c354-41e6-b98b-de5cd2c4b93e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.293988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 90/181] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:12.294841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.300382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.340563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.341231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.341530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.341823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.342631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=8a81889bb63444b2b7591804fdae4c69) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:12.342951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.344402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.353206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 92/182] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/role_assignments?user.id=8a81889bb63444b2b7591804fdae4c69&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:12.353206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.366443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.503706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9aae-e859-4fef-9b56-c7dd46c18193 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.541032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233e61-6ffe-41d3-b98a-d4b4f724387e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.575776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.576377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.576663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.576945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.591704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.592351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.592759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.593160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.595086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:12.595390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.596779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7921b-4f8a-4212-a755-e5de122370c0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.606868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 93/183] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:12.608187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5df99-6a99-4601-b8a3-8360736d703d None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.608473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5df99-6a99-4601-b8a3-8360736d703d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.608747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5df99-6a99-4601-b8a3-8360736d703d None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.610204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 94/184] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:12.616672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5df99-6a99-4601-b8a3-8360736d703d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.665013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.666671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2cc53-df47-4ca1-bc25-df83b50e8ac0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.675268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.716834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.760750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5df99-6a99-4601-b8a3-8360736d703d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.799809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 91/185] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:12.800900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.801192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.801474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.802505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.803474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.803954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.804424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.820411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:12.821602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:12.822989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:12.825785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:12.827649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 95/186] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:12.828629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.895186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 92/187] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:12.897205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:12.944860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.948960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69f3a-007c-4020-827e-07b48caaf195 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:12.977234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:12.988305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:12.990014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.990490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.990948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.004045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:13.010429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:13.011301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:13.012087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:13.014500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 96/188] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:13.015725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.024341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d16d23-caec-45b7-8a76-f17e8274b545 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.074407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.075071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.075714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.076087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] PATH_INFO: `/v3/projects/f10fe5ae14cc4348af9234def73b22d1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.077483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] RBAC: Authorizing `identity:get_project(project_id=f10fe5ae14cc4348af9234def73b22d1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.079154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.085902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 93/189] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:12 2022] GET /identity/v3/projects/f10fe5ae14cc4348af9234def73b22d1 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.086882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.145620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34952-5496-4350-8f6a-17b8572e9f6b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.188333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.188949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.189230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.189509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.217130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d41215-61c0-49de-91b1-004701113b7b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.217973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.250928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.258808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.259439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.260011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.260294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.260646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.260978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:13.261285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.262362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.262678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.277302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 94/190] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.277302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.371985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 97/191] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:13.371985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.385477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3538d7c-c4b4-4539-aba5-aa2b1d21594a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.419568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.420107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.420398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.420678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.421437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=f10fe5ae14cc4348af9234def73b22d1, user.id=5f6e22c993174f38bce5d39110d85361) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:13.421729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.423201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.429140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 95/192] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/role_assignments?user.id=5f6e22c993174f38bce5d39110d85361&scope.project.id=f10fe5ae14cc4348af9234def73b22d1&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.429979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.436820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.525794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688502-258b-4cfc-80fc-9451d7313073 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.561954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.593641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.594477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.594698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.595359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.597755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.599836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.603852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 98/193] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.603852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.638714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4b8-8137-46cf-a398-da1d439523f4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.690903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.691635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.691934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.692529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.694619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.696600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55601d0-1d57-4cbb-acf2-44b9fc433714 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 96/194] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83fb-0eca-447f-a200-d6b18cde4a7e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83fb-0eca-447f-a200-d6b18cde4a7e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83fb-0eca-447f-a200-d6b18cde4a7e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 97/195] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:13.698277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed83fb-0eca-447f-a200-d6b18cde4a7e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.743505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266021-7da1-491e-9f19-c8471df24d77 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.772367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.782169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.782868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.783163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.783444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.784595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.786078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ecc53-bca0-4599-98e6-b8cee8538a00 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.788310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 99/196] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:13.789581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.789899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.790184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.809440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:13.810767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.813812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed83fb-0eca-447f-a200-d6b18cde4a7e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.839637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.848432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.849611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.849926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.850203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.850849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.852290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.873489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 98/197] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:13.874426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.894963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 100/198] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:13.896412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.007559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25c05-91a4-4a8d-ae03-23902149fc0f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.052588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.052816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d72b-7869-44e5-b103-a7ccb0c58006 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.052902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.052902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.053197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.090976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.109703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.110420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.110705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.110982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.111722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=c8fb6ff3f6d846b19fa5f65974931072) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.112032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.113469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.119136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.120439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 101/199] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/role_assignments?user.id=c8fb6ff3f6d846b19fa5f65974931072&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.143801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.145322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.218806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.268081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 99/200] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:14.278755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.409788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f9ca8-eb22-43c0-b7c3-66bed0b77437 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.431418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.446098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a584-4b7e-495c-844e-ac47b5fc36c0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.494421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.495063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.495344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.495616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.517045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:14.522360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:14.523191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:14.523954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:14.525331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 102/201] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:14.527394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.528107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.528389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.528666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.529981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.530941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.532406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.534059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 100/202] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:14.543693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.618199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.666540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f60a-4ebc-4734-acb0-ff92f15b83b7 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.705427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.706169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.706827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.707111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.707985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=c8fb6ff3f6d846b19fa5f65974931072) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.708463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.709920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.715938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 101/203] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/role_assignments?user.id=c8fb6ff3f6d846b19fa5f65974931072&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.754198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a9da-a085-478f-9c04-6a4428a48a9b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.804826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.805455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.805745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.806068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.806869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:14.807183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.808587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.818325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 103/204] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:14.823605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:14.850650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:14.954204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69398-8c90-46f7-a62d-063d769eacfa None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:14.991719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:14.992354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:14.992636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:14.992910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] PATH_INFO: `/v3/users/2887ae5af6f44fbb91f4fb4f075618f0` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:14.994065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] RBAC: Authorizing `identity:get_user(user_id=2887ae5af6f44fbb91f4fb4f075618f0)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:14.995493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:14.997348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 102/205] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:14 2022] GET /identity/v3/users/2887ae5af6f44fbb91f4fb4f075618f0 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:15.002851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.155520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98afac-ab92-4f6a-97a5-75b35fad1369 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.170335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.196036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.196657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.196939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.197215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.269418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.270977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.371779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 104/206] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:15.377386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.478430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.484072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5990d9-b4e4-4bd3-b26e-3e4f8189b013 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.520222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.520888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.521170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.521442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.522597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.524045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c592-e0bd-4d28-af20-193a865f4f59 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.525669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 103/207] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:15.531526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:15.543903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:15.632812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab46d8-bae7-4ccc-a97c-056ebc4a0ae1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:15.667880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:15.668493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.668775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.669051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.669798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, scope.project.id=ec9daf7e93b24960b835d213842a3424, user.id=2887ae5af6f44fbb91f4fb4f075618f0) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:15.670114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:15.671539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f2e76-6175-44a2-904b-46c15e485f20 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:15.678165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 105/208] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:15 2022] GET /identity/v3/role_assignments?user.id=2887ae5af6f44fbb91f4fb4f075618f0&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:16.351726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa338-2b85-4206-8c16-606babe9ecb3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.352009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa338-2b85-4206-8c16-606babe9ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.352547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa338-2b85-4206-8c16-606babe9ecb3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.354427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 104/209] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:16.360079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fa2c-4931-4756-b721-b3b59242a878 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.360590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fa2c-4931-4756-b721-b3b59242a878 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.361103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965fa2c-4931-4756-b721-b3b59242a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.379688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b965fa2c-4931-4756-b721-b3b59242a878 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.381714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b965fa2c-4931-4756-b721-b3b59242a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.432734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72915-e0c8-40a0-8023-c7eb54e5d6a7 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.433348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72915-e0c8-40a0-8023-c7eb54e5d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.433910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72915-e0c8-40a0-8023-c7eb54e5d6a7 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.435741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 105/210] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:16.451668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.452386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.452872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.456224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 106/211] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:16.472778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602a05-6e91-4c15-a02c-4384fbee2665 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.473274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602a05-6e91-4c15-a02c-4384fbee2665 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.473514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.473929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602a05-6e91-4c15-a02c-4384fbee2665 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.474905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.475605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 107/212] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:16.480918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.481424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.481889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.490028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.501885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.503069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.563789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 106/213] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:16.603050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 108/214] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:16.732632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.817282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.833179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.839804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b373d6-eaa1-486a-9233-04ea76403271 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.882268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.883127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.883592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.884057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.894691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-16d875e6-8fbb-4453-89a3-3bc8ca4a45ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:16.899677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:16.900533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:16.901300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:16.903629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 107/215] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:16.905497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623af-7158-4aa4-8f72-1540ac2b5457 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.906418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623af-7158-4aa4-8f72-1540ac2b5457 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.906418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719623af-7158-4aa4-8f72-1540ac2b5457 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.907329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 108/216] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:16.908330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719623af-7158-4aa4-8f72-1540ac2b5457 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.948397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f431-461c-49ad-bfea-a30d61bf23b3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.981478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.982149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.982434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.982709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.983826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.985267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.986882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 109/217] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:16.987643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.990700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.011293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719623af-7158-4aa4-8f72-1540ac2b5457 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.044214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.044850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.045135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.045411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.053288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.056942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-0015c791-7d0c-42c6-b191-30f1f258d27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:17.062132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:17.063070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:17.063829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 109/218] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:17.064448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.064837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.065036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.082278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.083639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.087958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd7175-4e10-4e26-a770-4e85f3db9ea1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.121964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.122569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.122849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.123125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.123783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:17.124080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.125451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.133590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 110/219] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:17.134323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.149005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 110/220] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:17.150011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.200100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.241333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aef34b-ca4e-4822-a58e-5b939bfe16ae None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.251611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727683-7274-4021-8769-bcbd6e1a8791 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.275498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.276373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.276843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.277301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.278124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.279621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.279859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.285841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.287011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.287293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.287567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.288234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:17.288535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.289918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.298729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 111/221] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:17.299542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.303999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 111/222] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:17.304761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.424876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976383-1ecf-45cd-b8a5-a574218443d6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.448283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd51a2-7e8e-442a-a78e-e8ba73cd27ec None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.468258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.469064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.469350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.469629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] PATH_INFO: `/v3/users/e8af423318b84eafa786dfb41c40e2dd` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.472378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.484723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=e8af423318b84eafa786dfb41c40e2dd)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.486222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.487901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 112/223] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/users/e8af423318b84eafa786dfb41c40e2dd => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:17.488751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.491917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.492563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.492849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.493124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.494329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.495776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.497369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 112/224] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:17.502365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.553260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.623715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd8af-4f7c-4477-a6eb-7c2577a3bdb6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.638598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d191-4d73-4d39-923c-8a26f5dec8f1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.672819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.673642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.674136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.674307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.680127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.680681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.680967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.681233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.687763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:17.693336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:17.694455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:17.695217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 113/225] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:17.695860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.761526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.776173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.777754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.829978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91775-f4b1-4b5f-8348-d6854c99d251 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:17.842246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:17.872412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:17.873077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.873373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.873963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.875051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.876500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.883416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 114/226] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:17.883416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:17.906749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 113/227] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:17.912761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.012781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.016315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4afe-8647-494c-9b8e-4a521557c811 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.027919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e47b-e04f-4f7a-a505-13f2c447648c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.064442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.065790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.066219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.066673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.068099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:18.068618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.070090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.070505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.070762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.071046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.071322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/c8fb6ff3f6d846b19fa5f65974931072/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.073430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user_id=c8fb6ff3f6d846b19fa5f65974931072, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.075385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.080739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 115/228] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:18.081795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.099239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 114/229] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:17 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/c8fb6ff3f6d846b19fa5f65974931072/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:18.100670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.135636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.207856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bdcde-6b73-460e-ba37-bdacec77c58d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.236524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6979db-24e1-4588-8a34-fcb773c263c0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.253667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.254360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.254691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.255827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.257576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.259422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.261808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 116/230] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:18.271012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.301047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d297b-f104-45e2-822a-088958088acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.302907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d297b-f104-45e2-822a-088958088acd None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.303415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d297b-f104-45e2-822a-088958088acd None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.303978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d297b-f104-45e2-822a-088958088acd None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.306951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d297b-f104-45e2-822a-088958088acd None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.310620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d297b-f104-45e2-822a-088958088acd None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.313971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 115/231] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:18.320987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d297b-f104-45e2-822a-088958088acd None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.348800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.401570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864e497-c807-4904-a301-e97dfbdeb6f5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.412408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.444011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.445037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.445538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.446066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.446998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=e8af423318b84eafa786dfb41c40e2dd) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:18.448314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.450731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.457388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 117/232] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/role_assignments?user.id=e8af423318b84eafa786dfb41c40e2dd&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:18.460807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d297b-f104-45e2-822a-088958088acd None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.498019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.498665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.498948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.499224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.500369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.502105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f4d7-0647-4a02-9975-00e2010e0413 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.508715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 116/233] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:18.510086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.681711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886871-45dd-4f4b-afbe-19967a2fabfd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.731738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.732415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.732702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.732984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/c8fb6ff3f6d846b19fa5f65974931072/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.737683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user_id=c8fb6ff3f6d846b19fa5f65974931072, role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.739836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb436e0-3dad-4f10-8efd-dc38083555f0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.755797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 118/234] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:18 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/c8fb6ff3f6d846b19fa5f65974931072/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:19.669039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac034fb-3ed9-48d0-a94a-ca240ddfdd46 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.670305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac034fb-3ed9-48d0-a94a-ca240ddfdd46 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.670808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac034fb-3ed9-48d0-a94a-ca240ddfdd46 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.672359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 117/235] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:19.678498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d637f8-c4df-4d5d-9cb3-42c16d587c6e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.679022 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d637f8-c4df-4d5d-9cb3-42c16d587c6e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.679508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d637f8-c4df-4d5d-9cb3-42c16d587c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.698570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-26d637f8-c4df-4d5d-9cb3-42c16d587c6e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:19.700421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-26d637f8-c4df-4d5d-9cb3-42c16d587c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.727193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:19.781090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 119/236] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:19.847792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03990f-3e54-4658-9338-f4a7e9e3536a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.848067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03990f-3e54-4658-9338-f4a7e9e3536a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.848279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03990f-3e54-4658-9338-f4a7e9e3536a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.849926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 118/237] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:19.855376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.855668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.855938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.874895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:19.876081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.955746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 120/238] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:20.133998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03990f-3e54-4658-9338-f4a7e9e3536a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.242109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.263920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03990f-3e54-4658-9338-f4a7e9e3536a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.307908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.320443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.321090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.321371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.321646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.338933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:20.344188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:20.345053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:20.346251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 119/239] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:20.351446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.442574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.452694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8ea8-c337-488e-817a-c9078e97d451 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.493896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1f2b6-01fb-4b6b-b453-4800a2597276 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.533018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.534856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.535653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.536730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.537568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.538081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.538555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.539433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:20.539979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.541076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.542639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.543721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.545317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.548937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 121/240] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:20.557141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.568061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 120/241] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:20.576544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.586817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.671990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4929-42e3-44a8-ac6e-601c21b6174b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.689442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ceb7-2069-40aa-8df7-4640cae8fbcd None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.710631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.711191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.711603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.711946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.712844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.714209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b7991-bf49-4410-8019-d9e1b2c70628 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.729163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6019-268e-4125-949d-789914989108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.730000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6019-268e-4125-949d-789914989108 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.730254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6019-268e-4125-949d-789914989108 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.730587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6019-268e-4125-949d-789914989108 None admin] PATH_INFO: `/v3/users/b94102a64df2469a9cb4f95bf3529f87` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.738132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 122/242] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:20 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:20.740436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3bc5-d03d-4647-85db-e3cca84efa80 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.740952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3bc5-d03d-4647-85db-e3cca84efa80 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.741426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3bc5-d03d-4647-85db-e3cca84efa80 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.743165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 123/243] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:20.747718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6019-268e-4125-949d-789914989108 None admin] RBAC: Authorizing `identity:get_user(user_id=b94102a64df2469a9cb4f95bf3529f87)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:20.749211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6019-268e-4125-949d-789914989108 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:20.753812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 121/244] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/users/b94102a64df2469a9cb4f95bf3529f87 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:20.756047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6dbd-6fc2-4048-a311-14e1373b9b43 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.756424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6dbd-6fc2-4048-a311-14e1373b9b43 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.756777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6019-268e-4125-949d-789914989108 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:20.756886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6dbd-6fc2-4048-a311-14e1373b9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.785288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e93d6dbd-6fc2-4048-a311-14e1373b9b43 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:20.787450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e93d6dbd-6fc2-4048-a311-14e1373b9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:20.804904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.834871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:20.881939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6019-268e-4125-949d-789914989108 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:20.887705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 124/245] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:20.926268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ae64-4576-41f8-8d6a-7e1b3b56004b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.927196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ae64-4576-41f8-8d6a-7e1b3b56004b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.927546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ae64-4576-41f8-8d6a-7e1b3b56004b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.929724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 125/246] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:20.930818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:20.931455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.931738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.932013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.934729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:20.935236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:20.935700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:20.954996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:20.956628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:21.027170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.029430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.032904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 126/247] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:21.092473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.135040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 122/248] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:21.140433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.217132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.237405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.265645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f5b6-83ba-4342-acde-433e1e1305a7 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.308123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.308704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.308991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.309282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.310764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.312226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3b404-c9d7-4e81-861c-cec96eff26af None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.314218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 127/249] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:21.315383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0b90-40b7-454e-8310-847e4ccbfda1 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.315670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0b90-40b7-454e-8310-847e4ccbfda1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.315946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0b90-40b7-454e-8310-847e4ccbfda1 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.317213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 128/250] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:21.322937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0b90-40b7-454e-8310-847e4ccbfda1 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.354759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a088b-e060-4fa6-b4d5-9b6d33a706d2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.391860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.392918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.392918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.393114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.405814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-27e3e920-3315-428b-b64b-93ef944be7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:21.411502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:21.412536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:21.413511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:21.415471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 123/251] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:21.416799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.417230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.417669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.436373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:21.437798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:21.450636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0b90-40b7-454e-8310-847e4ccbfda1 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.457849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.489791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.490805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.491281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.491743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.502881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:21.508618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:21.509623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:21.510679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:21.511492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:21.512140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.515290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 124/253] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:21.516726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.523738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.633722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3effa66-5e96-4ab9-89d2-cce7ca8fefbf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.661050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf2f-0872-40b5-92de-a04818002b8a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.672504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.673191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.673491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.673888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.674576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:21.675134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.676239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.687361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 125/254] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:21.691358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.714941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.757308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.758064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.758261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.758543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.759310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=b94102a64df2469a9cb4f95bf3529f87) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:21.759580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.761029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.791521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 130/255] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/role_assignments?user.id=b94102a64df2469a9cb4f95bf3529f87&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:21.792432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.836435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1bda8-b2af-4059-a0b3-498f869db9e2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.900980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:21.901994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.902506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.903643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.904548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:21.905057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:21.906966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:21.921588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 126/256] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:21.922657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.997570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.054623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b476-db77-4534-a0a9-ed7eaac43603 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.073140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.100477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.101225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.101514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.101812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.103326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.104886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.106608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 131/257] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:22.107373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.108868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7aa73-223f-4ce8-a539-ba3bacbeb580 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.175070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.175600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.175886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.176166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.195080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:22.204818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:22.205691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:22.206499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:22.210566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 127/258] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:22.213083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.254141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba2bd-c71e-40c3-9f8a-a6b0f0072b9c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.308656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.309460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.309754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.310062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] PATH_INFO: `/v3/users/e8af423318b84eafa786dfb41c40e2dd` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.311355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] RBAC: Authorizing `identity:get_user(user_id=e8af423318b84eafa786dfb41c40e2dd)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.312800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.314948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 132/259] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/users/e8af423318b84eafa786dfb41c40e2dd => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:22.315734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.324227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.402257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cdf42-9364-4f10-8954-606bd552f1f4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.446818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c245948-f137-4eed-af65-f8c1de5a1c36 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.484689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.485316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.485603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.485916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.486598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:22.486908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.488298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.497339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 133/260] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:22.498243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.511114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.511770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.512063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.512342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.535837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.614826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.620093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fd02-0e7f-4b36-8a08-eb2af00f228c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.620235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.621751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.655917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.656843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.657233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.657626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.659406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.660887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.662828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 134/261] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:22.663748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.738199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 128/262] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:22.739536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.788188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.841826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbea8-9f71-4b94-b273-b9d2e7786f2d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.877552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.878278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.878570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.878853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/e8af423318b84eafa786dfb41c40e2dd/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.881409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user_id=e8af423318b84eafa786dfb41c40e2dd, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.882927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.900728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 129/263] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:22 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/e8af423318b84eafa786dfb41c40e2dd/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:22.902799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fc482-8e10-4427-befc-e040105bdc08 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:22.904149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.954751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.955419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.955706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.956056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] PATH_INFO: `/v3/users/c8fb6ff3f6d846b19fa5f65974931072` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.958471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] RBAC: Authorizing `identity:get_user(user_id=c8fb6ff3f6d846b19fa5f65974931072)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.960357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.962948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 135/264] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/users/c8fb6ff3f6d846b19fa5f65974931072 => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:22.968552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:22.972789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.097699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fc38-9d67-490f-931e-2754c1a58f0b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.135571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.141328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45c5d-17ab-4240-98bc-25ab49dc393b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.161749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.162540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.162827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.163105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.234976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.235660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.235949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.236234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.240306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.242731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.245078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 130/265] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:23.254162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:23.285461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.287937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.290441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.414929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 136/266] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:23.421421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:23.511989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e25f49-a87e-4562-ad93-9c92f434115d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.592572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.593566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.594208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.594683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.595618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=c8fb6ff3f6d846b19fa5f65974931072) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:23.596218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.597895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea94c-d1b1-449f-89db-fe2f9321ce5b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.607109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 131/267] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:23 2022] GET /identity/v3/role_assignments?user.id=c8fb6ff3f6d846b19fa5f65974931072&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:23.608417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb218c4-f581-440b-a908-688e37608bd6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.608850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813e15-6784-4d87-9744-622774d903c4 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.609329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813e15-6784-4d87-9744-622774d903c4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.610000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813e15-6784-4d87-9744-622774d903c4 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.610103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.612495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 132/268] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:23.614012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6dec6-ff8a-4f4c-a153-4ddb8e23db7b None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.619052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6dec6-ff8a-4f4c-a153-4ddb8e23db7b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.619052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6dec6-ff8a-4f4c-a153-4ddb8e23db7b None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.620302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 133/269] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:23.623733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.624011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.624281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.652310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:23.654605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.682634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.683196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.683479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.683754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.684984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.685655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:23.686532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502a48-c78b-46a9-86ce-de5f0aff9efb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.694527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 137/270] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:23 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:23.696044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f220-2420-4154-9291-07caee600f80 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.696329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f220-2420-4154-9291-07caee600f80 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.696601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f220-2420-4154-9291-07caee600f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.731742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5749f220-2420-4154-9291-07caee600f80 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:23.735206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5749f220-2420-4154-9291-07caee600f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:23.779193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 134/271] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:23.780921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:23.865833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 138/272] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:23.924358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31294326-bbbc-4b50-a7d8-74d14f47dca2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:23.961464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:23.962031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:23.962310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:23.962581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:23.963314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=c8fb6ff3f6d846b19fa5f65974931072) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:23.963656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:23.965215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:23.971998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 135/273] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:23 2022] GET /identity/v3/role_assignments?user.id=c8fb6ff3f6d846b19fa5f65974931072&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:24.269228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f220-2420-4154-9291-07caee600f80 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.287906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.327139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.390962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.396381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f220-2420-4154-9291-07caee600f80 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.431103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708d1d7-3e37-4cd6-8ebf-c44802977540 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.448615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.449617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.450657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.451168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.453304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.455688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafde66-15b1-4fbc-bc37-3c676ef610a2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.458231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 139/274] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:24.460092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9510-0446-41d9-8d24-dbdce0d60ad4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.460535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9510-0446-41d9-8d24-dbdce0d60ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.461605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9510-0446-41d9-8d24-dbdce0d60ad4 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.466373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 140/275] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:24.467492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9510-0446-41d9-8d24-dbdce0d60ad4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.478475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.479281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.479565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.479839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.490953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-36cc70be-9dcd-4172-a184-f9929864e478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:24.496618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:24.497466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:24.498260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 136/276] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:24.503649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.503649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.503649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.519671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:24.521385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:24.584209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9510-0446-41d9-8d24-dbdce0d60ad4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.606455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 137/277] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:24.607321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.621479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.622161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.622407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.622684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.623336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.625034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.630745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.651144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 141/278] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:24.733897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbef0c-a93b-4547-85a1-328bfea9234b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.775819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.776843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.777335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.777889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.778825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:24.779328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.781472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.791460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 138/279] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:24.796917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.826485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.881746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.913744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6eab2-764c-46a0-8558-0222b0bf174c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.956119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.956763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.957043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.957323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] PATH_INFO: `/v3/users/69497c6d5786473d8b31d38738187922` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.974582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] RBAC: Authorizing `identity:get_user(user_id=69497c6d5786473d8b31d38738187922)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:24.976056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:24.978069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 142/280] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/users/69497c6d5786473d8b31d38738187922 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:24.978686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.986334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.009901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51afdc-7072-4770-b5fb-bdd588a31a1c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.056993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.057571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.058000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.058438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.071205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:25.076528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:25.077356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:25.078629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 139/281] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:25.083632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.087461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:25.112298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc6100-a4bd-4844-abd6-08ec1582b6fe None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.159790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.161520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.162894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.163324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.164219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, user.id=69497c6d5786473d8b31d38738187922, scope.system=all) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:25.164701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.166374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.174416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 143/282] 10.222.0.61 () {56 vars in 1308 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/role_assignments?user.id=69497c6d5786473d8b31d38738187922&scope.system=all&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:25.199059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4eb2-08b7-4029-8ea9-8d76689fefce None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.239684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.240324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.240612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.240891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.241579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:25.241924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.243331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299211-9850-4aa8-9f68-47b3b7c38998 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.246116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:25.256562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 140/283] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:25.262497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.404985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b73b-a615-41a1-8e23-f9785e1e9b5d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.434562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c091-0aa7-435a-9860-856fe59f9097 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.434878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c091-0aa7-435a-9860-856fe59f9097 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.435121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c091-0aa7-435a-9860-856fe59f9097 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.436487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 141/284] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:25.447087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.447398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.447660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.448482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.449335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.449866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.450352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] PATH_INFO: `/v3/users/b94102a64df2469a9cb4f95bf3529f87` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.451702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b94102a64df2469a9cb4f95bf3529f87)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.453337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.455432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 144/285] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/users/b94102a64df2469a9cb4f95bf3529f87 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:25.461117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.481912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:25.483551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:25.485734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:25.621388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 142/286] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:25.631759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a1d60-a5fd-4f6e-99d1-8aa2ca6969b4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.667418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.668208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.668613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.668989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.670262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.671837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.673898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 145/287] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:25.683148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:25.832518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71dfb2-9645-4a13-829b-0056e4e103a1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:25.863342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:25.872754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:25.873426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:25.873712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:25.874021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/b94102a64df2469a9cb4f95bf3529f87/roles/dd4e548ecfaf4724a4a04743f167d3a7` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:25.875968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user_id=b94102a64df2469a9cb4f95bf3529f87, role_id=dd4e548ecfaf4724a4a04743f167d3a7)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.877425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.902816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 143/288] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:39:25 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/users/b94102a64df2469a9cb4f95bf3529f87/roles/dd4e548ecfaf4724a4a04743f167d3a7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:25.919820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.018676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.040114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf25d2-7c14-483b-9b25-7ad2e35f6866 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.078889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.079535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.079818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.080091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.090715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:26.095598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:26.096675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:26.097947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 146/289] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:26.103307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.216049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973406b-2baf-4e5d-8f8b-1f2cdc34d5a9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.259854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.260482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.260767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.261040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.261721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:26.262053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.263431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.273091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 144/290] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:26.278597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.400875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44654-0c56-4d21-9c66-09bb835f9b61 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.438739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.439478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.439657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.439933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] PATH_INFO: `/v3/users/e8af423318b84eafa786dfb41c40e2dd` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.441074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] RBAC: Authorizing `identity:get_user(user_id=e8af423318b84eafa786dfb41c40e2dd)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.442579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.444452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 147/291] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/users/e8af423318b84eafa786dfb41c40e2dd => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:26.449825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.528685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.603985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848546b5-2dc3-425b-9a84-fed6b4e9dd71 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:26.650701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:26.651748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:26.652244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:26.652710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:26.747350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:26.749162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:26.815183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.894850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 145/292] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:26.900623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:26.921863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:27.019798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098162-c642-4448-a6d8-988889b9a037 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.055061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.055699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.055984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.056259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.057384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:27.058974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c3eb-3e1c-4d32-8241-f0ef1e564eb2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:27.060926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 148/293] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:26 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:27.066481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.217908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a449e-f9a0-414a-b5ec-4f686a3f1d1e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.218251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a449e-f9a0-414a-b5ec-4f686a3f1d1e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.218475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a449e-f9a0-414a-b5ec-4f686a3f1d1e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.220098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 149/294] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:27.225981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.226283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.226563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.233863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cffc8-ba42-43a0-826b-48d7f65f16b8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.257216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:27.259787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:27.301901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.302887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.303364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.303829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.304998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=e8af423318b84eafa786dfb41c40e2dd) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:27.306505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:27.308315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082c068-3ba8-4dae-a673-ed99d14907bc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:27.320430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 146/295] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:27 2022] GET /identity/v3/role_assignments?user.id=e8af423318b84eafa786dfb41c40e2dd&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:27.324959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4b5e-e640-4d4a-9046-8c22bdde934d None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.325733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4b5e-e640-4d4a-9046-8c22bdde934d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.326977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4b5e-e640-4d4a-9046-8c22bdde934d None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.328653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 147/296] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:27.336736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.337562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.340734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.374770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:27.376415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:27.388049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:27.441098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 150/297] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:27.462203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 148/298] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:27.739010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.751864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:27.781883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.861040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42522d2-6cf3-4fd2-9059-d0b321cc8394 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.901252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.901965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.902248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.902526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.903645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:27.905093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2575c28-6b21-4800-85fb-45890c40e26b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:27.906513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3b97c-c01e-4a22-acbe-eaddd15f489b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:27.906973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 151/299] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:27.912273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852c6c-76e6-4334-8953-41bf4817e840 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.912560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852c6c-76e6-4334-8953-41bf4817e840 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.912838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc852c6c-76e6-4334-8953-41bf4817e840 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.914168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 152/300] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:27.919100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc852c6c-76e6-4334-8953-41bf4817e840 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:27.947987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:27.948622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.948913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.949181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.959290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-094d5cd0-e400-43cc-aad4-05bd79ab7c9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:27.963946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:27.964810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 149/301] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:27.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:27.971451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:27.971451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:27.975517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:27.987349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:27.988538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:28.005857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.033533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc852c6c-76e6-4334-8953-41bf4817e840 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.060672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 150/302] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:28.067644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.075857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.076530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.076817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.077140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] PATH_INFO: `/v3/groups` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.077917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.079927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1566a-82f2-4574-bbcd-efefec6b5777 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.109824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 153/303] 10.222.0.61 () {60 vars in 1134 bytes} [Wed Aug 24 05:39:27 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:28.194187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0db899-d786-435c-b134-7443ea1688c5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.234395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.235168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.235463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.235755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.236436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:28.236747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.238207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.239867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.250893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 151/304] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:28.257037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e730-0fb7-48c8-9dfa-905821f766d0 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.257267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e730-0fb7-48c8-9dfa-905821f766d0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.257556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e730-0fb7-48c8-9dfa-905821f766d0 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.258843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.259174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 154/305] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:28.264840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.265372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.265919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.286983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:28.288471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:28.362738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 155/306] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:28.363501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.370850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab04f7-061b-49d4-95f4-8e1f3854550a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.408592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.409571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.410078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.411139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] PATH_INFO: `/v3/users/c8ac103a70e2499abb1b90c43648c7df` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.425676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] RBAC: Authorizing `identity:get_user(user_id=c8ac103a70e2499abb1b90c43648c7df)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.428213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.430527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 152/307] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/users/c8ac103a70e2499abb1b90c43648c7df => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:28.436003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.449097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.495978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb5062-8ca5-4f9a-b7fc-0b896592333e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.502113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.544779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.546427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.546891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.547611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.561788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80648-57c2-44f2-974d-1dc36888aed4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.562891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:28.569278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:28.570316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:28.571063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:28.572114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 156/308] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:28.577971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.593563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.594210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.594494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.594773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.595506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, user.id=c8ac103a70e2499abb1b90c43648c7df, scope.system=all) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:28.595816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.597249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.603841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 153/309] 10.222.0.61 () {56 vars in 1308 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/role_assignments?user.id=c8ac103a70e2499abb1b90c43648c7df&scope.system=all&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:28.649078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.701233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea83f-a028-46db-be93-e41eec1b61ff None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.731588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.742972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.743966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.744461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.744927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.745815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:28.746328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.747924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.757141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 157/310] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:28.762900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.773368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd6c3-4666-4cdf-a0b9-b791e3882601 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.802352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.814883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.815561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.815849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.816128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.828589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:28.834072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:28.834941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:28.835715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 154/311] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:28.846914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.894048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc83e-40b5-4217-8a4e-22b49888b2a5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:28.941537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:28.945013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:28.945475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:28.945931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] PATH_INFO: `/v3/users/69497c6d5786473d8b31d38738187922` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:28.947282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] RBAC: Authorizing `identity:get_user(user_id=69497c6d5786473d8b31d38738187922)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:28.948893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:28.951431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 158/312] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/users/69497c6d5786473d8b31d38738187922 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:28.957144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:28.979229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aa06b-7b2e-4e7c-96f2-b3f3eb854c60 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.017995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:29.023950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.024777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.025207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.025628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.026480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:29.026930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.028770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.038520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 155/313] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:29.046201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.072126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44054b-10a9-4092-b4d9-4228c3f42297 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.093711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:29.110271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.111263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.111719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.112165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] PATH_INFO: `/v3/system/users/69497c6d5786473d8b31d38738187922/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.114015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69497c6d5786473d8b31d38738187922, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.115557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.133063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 159/314] 10.222.0.61 () {58 vars in 1334 bytes} [Wed Aug 24 05:39:28 2022] PUT /identity/v3/system/users/69497c6d5786473d8b31d38738187922/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:29.163656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745b4b-6f88-4b99-92e9-66e572c6fb52 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.203906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.204628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.204923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.205410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] PATH_INFO: `/v3/users/b94102a64df2469a9cb4f95bf3529f87` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.206788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] RBAC: Authorizing `identity:get_user(user_id=b94102a64df2469a9cb4f95bf3529f87)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.208896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.211187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 156/315] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/users/b94102a64df2469a9cb4f95bf3529f87 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:29.217130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.333620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89be3b-2799-42e2-9bf7-38578a7ab5b8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.354099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:29.371215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.371835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.372123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.372398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.443127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.444590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.547971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 160/316] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:29.555794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.667304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f00a-0780-4910-a58e-cdc2b427987c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.677353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:29.703565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.704224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.704509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.704789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.706021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.707537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632419c-e4ac-48d4-84aa-9778b486b803 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.709273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 157/317] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:29.715352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:29.737315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:29.816794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff4bc-f0bc-42f7-b644-2218ce3e0a15 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:29.855643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:29.856341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:29.856628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:29.856902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:29.857628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, user.id=b94102a64df2469a9cb4f95bf3529f87) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:29.857972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:29.859398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4837-e7f9-4905-9820-6d4ad835170c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:29.866234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 161/318] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:29 2022] GET /identity/v3/role_assignments?user.id=b94102a64df2469a9cb4f95bf3529f87&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:30.171459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9b20b-3dd2-433e-8103-8a73b8a83fac None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.171961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9b20b-3dd2-433e-8103-8a73b8a83fac None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.172077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9b20b-3dd2-433e-8103-8a73b8a83fac None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.173681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 158/319] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:30.179054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271497-ca1d-4351-bc3c-1431df015bc9 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.179351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271497-ca1d-4351-bc3c-1431df015bc9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.179628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271497-ca1d-4351-bc3c-1431df015bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.197909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1b271497-ca1d-4351-bc3c-1431df015bc9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:30.199129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1b271497-ca1d-4351-bc3c-1431df015bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:30.276472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 162/320] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:30.544034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9b20b-3dd2-433e-8103-8a73b8a83fac None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:30.548242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b9e6-5254-4b35-bff1-5c6544433f76 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.549117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b9e6-5254-4b35-bff1-5c6544433f76 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.549604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125b9e6-5254-4b35-bff1-5c6544433f76 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.551511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 163/321] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:30.556659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.556953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.557237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.576617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:30.577829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:30.588714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:30.651250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 164/322] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:30.657556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9b20b-3dd2-433e-8103-8a73b8a83fac None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:30.694196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:30.694835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.695121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.695397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.696494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:30.697964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:30.701797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 159/323] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:30.705128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:30.807914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08c72c-232c-4123-a8a9-1c5091611844 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:30.841577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:30.842217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:30.842505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:30.842782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] PATH_INFO: `/v3/groups` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:30.843403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:30.844841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:30.861198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 165/324] 10.222.0.61 () {60 vars in 1134 bytes} [Wed Aug 24 05:39:30 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:30.922319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:30.971763 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.033304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c646e-4045-4e0f-a125-90ff815eac08 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.071660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.072234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.072527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.072808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.084090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-14df6f5d-be48-4de2-813a-c0d7729cb604 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:31.089461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:31.090365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:31.091130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 160/325] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:31.097494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.101947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.193669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1419-b0a7-418d-88cf-60bbc0816850 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.194272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1419-b0a7-418d-88cf-60bbc0816850 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.194272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1419-b0a7-418d-88cf-60bbc0816850 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.195577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 161/326] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:31.201585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.202039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.202414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.212271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bf293-9bba-45b8-b367-7a95b2c2b26b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.225422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:31.227451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:31.259028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.259028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.259289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.259844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.260200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:31.260510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.262073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:31.272257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 166/327] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:31.278466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.312748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 162/328] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:31.354145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.397026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed10fe-c823-4a98-b55f-123d68746d9f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.440524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.441168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.441452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.442289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] PATH_INFO: `/v3/users/c8ac103a70e2499abb1b90c43648c7df` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.444785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] RBAC: Authorizing `identity:get_user(user_id=c8ac103a70e2499abb1b90c43648c7df)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.446847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:31.450001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 167/329] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:31 2022] GET /identity/v3/users/c8ac103a70e2499abb1b90c43648c7df => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:31.455639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.496642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.575554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c713-6e41-435b-9a8c-4e16d2f077a6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.613953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.614567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.615294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.615580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.615857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] PATH_INFO: `/v3/system/users/c8ac103a70e2499abb1b90c43648c7df/roles/dd4e548ecfaf4724a4a04743f167d3a7` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.617268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8ac103a70e2499abb1b90c43648c7df, role_id=dd4e548ecfaf4724a4a04743f167d3a7)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.618670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:31.629951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 163/330] 10.222.0.61 () {58 vars in 1334 bytes} [Wed Aug 24 05:39:31 2022] PUT /identity/v3/system/users/c8ac103a70e2499abb1b90c43648c7df/roles/dd4e548ecfaf4724a4a04743f167d3a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:31.757193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96347c-d88d-48b8-9638-23ec49f7ee9c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.797042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.797687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.797999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.798281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.801602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.812390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:31.818224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:31.819052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:31.820224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 168/331] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:31.825178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:31.939194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:31.943617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c4158-bed9-4575-a737-e69b7f3bde0b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:31.986512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:31.987532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:31.988017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:31.989032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:31.989926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:31.990466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:31.992009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:32.005472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 164/332] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:32.010640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:32.150624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810af37-7163-46ad-82e6-1c9f33997153 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:32.194098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:32.194674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:32.194958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:32.195237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] PATH_INFO: `/v3/users/69497c6d5786473d8b31d38738187922` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:32.196388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] RBAC: Authorizing `identity:get_user(user_id=69497c6d5786473d8b31d38738187922)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:32.197858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4519b58-6b47-4583-9c0d-1634fcd3757a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:32.199441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 169/333] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:32 2022] GET /identity/v3/users/69497c6d5786473d8b31d38738187922 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:32.205482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:32.335769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c8fb-18f7-4471-9107-ea9daf1f0ed4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:32.379997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:32.380627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:32.380912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:32.381193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:32.381967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] RBAC: Adding query filter params (role.id=18d95dfd99d24cd5b5cadd6cf43b7154, user.id=69497c6d5786473d8b31d38738187922, scope.system=all) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:32.382280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:32.383725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeda3c-1dae-4163-9540-2f351e31ff40 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:32.396915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 165/334] 10.222.0.61 () {56 vars in 1308 bytes} [Wed Aug 24 05:39:32 2022] GET /identity/v3/role_assignments?user.id=69497c6d5786473d8b31d38738187922&scope.system=all&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:33.191097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-b4fd-4cc3-8be6-38858a0bb822 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.192162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-b4fd-4cc3-8be6-38858a0bb822 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.192642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-b4fd-4cc3-8be6-38858a0bb822 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.194528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 170/335] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:33.199584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d85a11-3a48-4e2c-aa85-2ffd25f6c108 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.200102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d85a11-3a48-4e2c-aa85-2ffd25f6c108 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.200572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d85a11-3a48-4e2c-aa85-2ffd25f6c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.221060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-49d85a11-3a48-4e2c-aa85-2ffd25f6c108 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:33.223690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-49d85a11-3a48-4e2c-aa85-2ffd25f6c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:33.240898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:33.307248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 166/336] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:33.646216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d8f8-b1bb-443e-bbb5-65a661ba7e1c None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.646507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d8f8-b1bb-443e-bbb5-65a661ba7e1c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.647021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d8f8-b1bb-443e-bbb5-65a661ba7e1c None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.648811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 171/337] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:33.654165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:33.654655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:33.655101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:33.680494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:33.682129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:33.767445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 167/338] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:33.876862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d8f8-b1bb-443e-bbb5-65a661ba7e1c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:33.957794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:34.011418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d8f8-b1bb-443e-bbb5-65a661ba7e1c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:34.054376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:34.055387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.055874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.056347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.071404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:34.076941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:34.077790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:34.078567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:34.081147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 172/339] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:34.088182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.201386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.230146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:34.251994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da45865-c5b0-4adb-9544-da353cc1cab2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:34.312842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:34.313491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.313801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.314086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.314762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:34.315068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:34.316468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:34.331150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 168/340] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:34.336889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.353667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467284c-73be-4de4-8906-0ca62a8140a5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:34.385821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:34.402772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:34.403419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.403701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.403978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.430695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:34.435557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:34.436402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:34.437152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 173/341] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:34.444071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.570486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bccc1-f8b5-476b-b12e-c7d722c92198 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:34.575724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ffe91-a08f-438b-8ff5-35d6384e858e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:34.616453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:34.617076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.617357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.617630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.618337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:34.618644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:34.620027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49b23-08a8-46d6-b2f1-9bbec232c501 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:34.637663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 174/342] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:34.639443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded66f1-e6f7-44f0-9cde-dd6c81a0e74a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.639730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded66f1-e6f7-44f0-9cde-dd6c81a0e74a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.640009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded66f1-e6f7-44f0-9cde-dd6c81a0e74a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.641234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 175/343] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:34.647500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:34.648134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.648420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.648703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.650427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.650705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.650979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.669401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:34.694665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:34.695873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:34.746216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:34.784187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:34.786973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03125-227f-4210-abfd-f438415e6a1f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:34.792561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 176/344] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:34.793431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.949953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 169/345] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:34.951583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a09dc-2a92-44f0-85ff-4fbcb187f299 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:34.951876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a09dc-2a92-44f0-85ff-4fbcb187f299 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:34.952153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a09dc-2a92-44f0-85ff-4fbcb187f299 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:34.953717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 170/346] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:34.959474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a09dc-2a92-44f0-85ff-4fbcb187f299 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:34.975716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae46733-fc72-47d1-b0a7-61b580c3d3b8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.014425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.048466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.049688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.049995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.050548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.113547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a09dc-2a92-44f0-85ff-4fbcb187f299 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.129987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.175383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.178600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.184329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.184986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.185268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.185545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.186793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.188245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9410-f5b0-4fc2-87b8-c8969af76164 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.189922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 171/347] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:35.191059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.191881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.192160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.235573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:35.236790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:35.304558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 177/348] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:35.305413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.315971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 172/349] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:35.317419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.364168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.408237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.435920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944371-245c-448e-9be9-c73dcde6e855 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.439845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a9c6-9d1a-4680-8423-80bcf507be9e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.484444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.485095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.485382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.485712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.485916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.486532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.486822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.487102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.493312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.494955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.497271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 178/350] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:35.498077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.502682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8794f411-0162-4bd3-b9d3-23acfb5f0b39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:35.508264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:35.510366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:35.511529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:35.514416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 173/351] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:35.515671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c176-d787-4f81-844e-72dd4dc999d0 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.515958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c176-d787-4f81-844e-72dd4dc999d0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.516234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c176-d787-4f81-844e-72dd4dc999d0 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.517508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 174/352] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:35.520350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2c176-d787-4f81-844e-72dd4dc999d0 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.638895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593485-688f-4a10-be5d-ad98b30c47b6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.642437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.649617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2c176-d787-4f81-844e-72dd4dc999d0 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.688924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.689623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.689942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.690220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.691454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.692901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.693366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.694153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.694556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.694863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 179/353] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:35.695077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.695704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.696092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=ec9daf7e93b24960b835d213842a3424) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:35.696506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.698100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670d-5b54-470a-b035-c16182cee337 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.704579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 175/354] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:35.706672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.706903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.707188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.707463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.728049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:35.729283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:35.819987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 176/355] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:35.820884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.837358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13dbd-046f-4c7b-be1e-1acccf35c2b0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.886047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.887229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.887697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.888151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.889003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] RBAC: Adding query filter params (name=member) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:35.889508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.891605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:35.901188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 180/356] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:35.902925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:35.953328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1365c53-e27f-4c60-9ff4-48d8cbd88c80 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:35.956610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.993482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:35.994542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:35.995080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:35.995547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:35.996999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:35.998661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75654ae-21e9-4e82-89cd-ddc3ae363d4a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.000502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 177/357] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:36.001991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a541-b421-4e6e-9e12-edccb8291a65 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.002477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a541-b421-4e6e-9e12-edccb8291a65 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.002979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a541-b421-4e6e-9e12-edccb8291a65 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.005102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 178/358] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:36.005388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.006247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a541-b421-4e6e-9e12-edccb8291a65 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.012798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf679-a117-4e70-8194-ecdb4e899cca None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.052174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.052911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.053269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.053616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.065246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-4be839a8-872b-4c1d-856a-61683943f7b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:36.071455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:36.072318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 181/359] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:36.076230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.077091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.077091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.095370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:36.096829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:36.130181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a541-b421-4e6e-9e12-edccb8291a65 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.177801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 182/360] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:36.177988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.177988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.178163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.178231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.178231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.218331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.251164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.275268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.277532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.303632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed3b7-25ee-4422-8f6e-d377b3eeff93 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.345069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.346364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.346911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.347385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.348397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=ec9daf7e93b24960b835d213842a3424) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:36.348853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.350563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.362304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 183/361] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:36.364121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.397470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 179/362] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:36.398778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.473316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.526670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff860-0719-40d3-8581-e805877e2152 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.548583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652123a-92a7-47cc-a9c4-618f6bca6008 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.576285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.576673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.576953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.577224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.579808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.592794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:36.598196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:36.599094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:36.599868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 180/363] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:36.600504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.601485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.602656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.603144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.603764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.605044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:36.605602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.607334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.621249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 184/364] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:36.622500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.735192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45c35-0bec-4f66-aa0b-fa8b3f01ae23 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.757270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.767681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517130b-6622-4c9e-907c-edbafc4a4190 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.775090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.775727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.776011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.776292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.777431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.778897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.780522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 181/365] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:36.781374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.805721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.806511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.806868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.807214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.822689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:36.831928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:36.832822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:36.833600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 185/366] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:36.834775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:36.890195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:36.922858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59518-74c2-42fd-beb4-c9b4e8fa2f02 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.960307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0b18-b73b-4d9d-9862-cb5e1f116b4f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:36.969748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:36.970407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:36.970692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:36.971010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:36.974068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:36.974381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:36.975766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:36.984920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 182/367] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:36.985650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.005449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.006177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.006463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.006738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] PATH_INFO: `/v3/users/c8ac103a70e2499abb1b90c43648c7df` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.007939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] RBAC: Authorizing `identity:get_user(user_id=c8ac103a70e2499abb1b90c43648c7df)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.010593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.017494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 186/368] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/users/c8ac103a70e2499abb1b90c43648c7df => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.018612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.056897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.123041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031b7a-b525-4365-b737-8b336bf02696 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.154866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67796-a5d4-48a3-a9d2-bca5eedd3b7b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.169806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.170610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.170977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.171356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.172584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.173131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.175368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.179341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 183/369] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:36 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.185430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.201177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.202313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.202657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.202929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.203922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:37.204227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.205954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.221800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 187/370] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.222518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.312851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5a18b-55ce-4947-9a1a-fce3d1f92e0b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.335423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.357192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.357985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.358373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.358749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.360345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e44c-67f1-4fed-b29a-9b8a1a7fae96 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.414065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.414065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.414591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.414965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.415833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] RBAC: Adding query filter params (role.id=dd4e548ecfaf4724a4a04743f167d3a7, user.id=c8ac103a70e2499abb1b90c43648c7df, scope.system=all) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:37.416656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.418514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.433600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 188/371] 10.222.0.61 () {56 vars in 1308 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/role_assignments?user.id=c8ac103a70e2499abb1b90c43648c7df&scope.system=all&role.id=dd4e548ecfaf4724a4a04743f167d3a7 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.435109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.451082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.453102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.479985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.578824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9814a1-0c8d-4662-825f-49581ac81de4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.605174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 184/372] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:37.606535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.644373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.654777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.655414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.655696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.656025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.656933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:37.657248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.658730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.670756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 189/373] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.671758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:37.816867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585411bb-c004-4358-a62c-fd40796fdee1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.867899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.867899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.867899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.867899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.886860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:37.907958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4a6-bef5-4363-93a1-e4470981d77d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:37.968955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.969733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:37.970661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.970764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3d62-d416-49a7-87c0-db147fd2476d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.971251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.971723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.973396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:37.975941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce11d4-5013-4347-b5e3-9c584e9ca388 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:37.978363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 190/374] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:37.979879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae1cde-71ad-41ba-ab68-2da07f641f71 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:37.980381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae1cde-71ad-41ba-ab68-2da07f641f71 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:37.980897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae1cde-71ad-41ba-ab68-2da07f641f71 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:37.982362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 191/375] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:37.988027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae1cde-71ad-41ba-ab68-2da07f641f71 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.001585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.117112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 185/376] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:38.118638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.118936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.119220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.125428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae1cde-71ad-41ba-ab68-2da07f641f71 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.146334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:38.147554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:38.164914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.165607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.165928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.166390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.167898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.169791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.172189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 192/377] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:37 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:38.172979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.213113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.244581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 186/378] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:38.245367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.302342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff3bc-fd7c-4209-afe4-e21e91256b0b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.314330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.347116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.347841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.348268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.348545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] PATH_INFO: `/v3/projects/3d992e7dad954566a305a48a7522cc33` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.349884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] RBAC: Authorizing `identity:get_project(project_id=3d992e7dad954566a305a48a7522cc33)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.352531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.355535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 193/379] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/projects/3d992e7dad954566a305a48a7522cc33 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:38.363557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.419962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13306a-25d0-4772-a7a9-b7ddbd07aeed None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.489226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.489855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.490138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.490408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.491441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:38.491750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.493176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.507629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 187/380] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:38.514138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.517893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d37f-d0a4-44c1-9428-97448dfdc1cc None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.562811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.563471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.563756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.564036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] PATH_INFO: `/v3/groups/340755191fa9451f9bda63bcc74cc833` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.572715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] RBAC: Authorizing `identity:get_group(group_id=340755191fa9451f9bda63bcc74cc833)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.572715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.574263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 194/381] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/groups/340755191fa9451f9bda63bcc74cc833 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:38.581730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.704823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c268-59b0-48ac-9d0f-b0ca1afc8b86 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.719325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:38.726018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.746837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.747460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.747744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.748022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.748760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] RBAC: Adding query filter params (group.id=340755191fa9451f9bda63bcc74cc833, role.id=e815260061204037a403daee014c9531, scope.project.id=3d992e7dad954566a305a48a7522cc33) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:38.749075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:38.750534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151bd81-0944-4d55-a5d8-1e5425c15a4b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:38.757326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 188/382] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/role_assignments?group.id=340755191fa9451f9bda63bcc74cc833&scope.project.id=3d992e7dad954566a305a48a7522cc33&role.id=e815260061204037a403daee014c9531 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:38.836387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5a776-b856-4910-b635-652d2a3c8d7c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.836676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5a776-b856-4910-b635-652d2a3c8d7c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.836873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5a776-b856-4910-b635-652d2a3c8d7c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.838515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 189/383] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:38.843559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.843856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.844133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.864189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622ce6e-eaa5-4160-aaae-d33e9f7f9bc8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:38.870792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:38.872008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:38.913384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:38.914102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:38.914394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:38.914674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:38.935421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:38.941051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:38.942688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:38.943671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 195/384] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:38.951416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:38.978460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 190/385] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:38.987763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.073268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abe4bd-3ae9-4650-9579-3e11ef8e5e8f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.113959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.114505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.114788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.115065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.115747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] RBAC: Adding query filter params (name=member) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:39.116053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.117425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.129879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 196/386] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:39.132711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.277666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b75d3-8086-4478-9716-f0aae740fc61 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.286589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.318355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.319080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.319274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.319556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.320695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.322184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.324115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 191/387] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:39.329209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.380518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.456764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.474399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2a45-84bc-4f12-8344-647847bcfd89 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.516526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.517411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.518380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.518828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.520245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.521916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.524574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 197/388] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:39.530648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.573268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027537-4211-4a54-8bc6-8258c171d7ee None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.628405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.629130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.629415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.629693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.650036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:39.655563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:39.656413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:39.657183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:39.665914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 192/389] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:39.669806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.720147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:39.725054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f031ac-4a47-470a-8a5b-08c8583ac203 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.784301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.786454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.786948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.787444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/groups/66d3070b6880441d9e737824541ebc4c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.790733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, group_id=66d3070b6880441d9e737824541ebc4c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.792785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.810562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 198/390] 10.222.0.61 () {58 vars in 1442 bytes} [Wed Aug 24 05:39:39 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/groups/66d3070b6880441d9e737824541ebc4c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:39.817426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c436-b84a-4f4f-b598-e9e6f55f62a0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:39.859875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:39.860503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:39.860789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:39.861068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:39.861809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:39.862135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:39.863602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:39.873822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 193/391] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:39.879605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:39.904275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.006740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c0067-7336-4efd-94ba-11c4f20150c1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.046169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.047076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.047502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.047921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.049190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.050985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33879789-7058-40be-976c-f19cdc832d73 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.053019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 199/392] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:39 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:40.058633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.159633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d184c4-3611-429c-bd1e-113f21dec3b6 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.160430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d184c4-3611-429c-bd1e-113f21dec3b6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.160701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d184c4-3611-429c-bd1e-113f21dec3b6 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.162395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 200/393] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:40.164713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.167515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.167815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.168211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.173609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9129-b522-44f5-b29f-9e3a13d949ef None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.190210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:40.192232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:40.230995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.231935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.232388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.232805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.234116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.235978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.238281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 194/394] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:40.244754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.370935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01747a6-0816-4a23-b802-405b4b806e1e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.379607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 201/395] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:40.410858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.411806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.412283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.412734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424/groups/66d3070b6880441d9e737824541ebc4c/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.415471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9daf7e93b24960b835d213842a3424, group_id=66d3070b6880441d9e737824541ebc4c, role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:40.417124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:40.432288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 195/396] 10.222.0.61 () {58 vars in 1442 bytes} [Wed Aug 24 05:39:40 2022] PUT /identity/v3/projects/ec9daf7e93b24960b835d213842a3424/groups/66d3070b6880441d9e737824541ebc4c/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:39:40.728284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.743862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.839231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5b93-b339-4668-b9b7-df0a6722c927 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:40.882489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:40.883195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.883535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.883862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.898438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:40.903567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:40.904423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:40.905170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 202/397] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:40.911527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:40.946837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:41.044383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a974-3d7e-4652-a7a5-2f93cfada59f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.091093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.091718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.092011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.092348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.093028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:41.093332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.094723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.107353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 196/398] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:41.112915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:41.192986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:41.224553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141fa3-ea3a-49ef-8a2c-34cb7573cd00 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.259535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.260214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.260498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.260770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.263487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.265011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.266931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 203/399] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:41 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:41.272896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:41.365911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:41.387647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1f070-651d-48eb-9ed0-203ed520c197 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.435871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.436564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.436851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.437140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.442446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.443889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eec4e-8440-4624-8d3d-4bf6c08c3137 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.445685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 197/400] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:41 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:41.451302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:41.531328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58a16-cd28-447d-9f2c-23aac1c4ba7c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.531638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58a16-cd28-447d-9f2c-23aac1c4ba7c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.534843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58a16-cd28-447d-9f2c-23aac1c4ba7c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.534843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 198/401] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:41.538964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.539259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.539538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.565838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2029a2-6f93-4ee6-8949-58204040a42d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:41.598748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:41.599957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.615322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:41.616115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.616338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.616612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/groups/66d3070b6880441d9e737824541ebc4c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.619417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, group_id=66d3070b6880441d9e737824541ebc4c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:41.620859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8291e95-6135-4da6-bb54-f296343fbda3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:41.642166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:41.646512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 204/402] 10.222.0.61 () {58 vars in 1442 bytes} [Wed Aug 24 05:39:41 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/groups/66d3070b6880441d9e737824541ebc4c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:41.692017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ea94-a4f7-4df8-be9b-352f1e25e6c6 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.692359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ea94-a4f7-4df8-be9b-352f1e25e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.692565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ea94-a4f7-4df8-be9b-352f1e25e6c6 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.694316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 205/403] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:41.699484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:41.699773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:41.700049 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:41.721328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:41.723156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.763036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 199/404] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 05:39:41.833708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 206/405] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:42.032401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.122348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.139719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933614-2ad7-482c-b050-8d6b37adb385 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.188857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.189494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.189792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.190067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.205031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:42.209781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:42.210660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:42.211404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 200/406] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:42.217060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.261062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.379846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64532a-c152-422e-869e-4226b714f7c3 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.390558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66d56-41ee-4299-9ed4-c5173f650a6a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.415726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.423329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.423947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.424255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.424515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.425167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:42.426123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.427751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4a9a3-ed74-4fee-8c5e-95ae02568556 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.436430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.436661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 207/407] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:42.437533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.437954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57b0a-73f5-4b03-8af1-f6a5b2f5d21c None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.438234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.438335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57b0a-73f5-4b03-8af1-f6a5b2f5d21c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.438510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57b0a-73f5-4b03-8af1-f6a5b2f5d21c None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.438931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.439707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 208/408] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:42.444692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57b0a-73f5-4b03-8af1-f6a5b2f5d21c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.451843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f66b5a03-c520-4b9f-a24e-2131312de7f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:42.458328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:42.459199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:42.459944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:42.462774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 201/409] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:42.464336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.464771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.465569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.475446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.490666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:42.492157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:42.564649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57b0a-73f5-4b03-8af1-f6a5b2f5d21c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.577468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 202/410] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:42.578629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.630893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.631538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.631886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.632232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.634355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.636031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.637846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 209/411] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:42.643566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.698481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c457a-6d05-44b6-9557-64a380fc673f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.741555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.742924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.743384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.743821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.744650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:42.745297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.746994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.750096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.756234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:42.758734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 203/412] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:42.764429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.836469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ba68-c5a0-4ad6-bcf7-a6b823c3dfba None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.882148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872db3da-29e8-42a1-844b-c8d570a7e123 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:42.904393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.905027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.905320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.905598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.906831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.908329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acdd70-5836-48c0-be0e-3f9bdc48fc1c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.911064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 210/413] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:42.912269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30588-b358-4bdd-b249-15d5fe13cee4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.912556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30588-b358-4bdd-b249-15d5fe13cee4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.912988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d30588-b358-4bdd-b249-15d5fe13cee4 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.914257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 211/414] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:42.919123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d30588-b358-4bdd-b249-15d5fe13cee4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:42.926327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:42.927226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.927732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.928261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] PATH_INFO: `/v3/groups/340755191fa9451f9bda63bcc74cc833` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.930145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] RBAC: Authorizing `identity:get_group(group_id=340755191fa9451f9bda63bcc74cc833)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:42.932207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97699ef8-8bb3-4a4f-bafa-ae30d1b7dff4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:42.935058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 204/415] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:42 2022] GET /identity/v3/groups/340755191fa9451f9bda63bcc74cc833 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:42.937071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:42.937812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:42.938240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:42.962184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:42.963347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:43.030077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.041300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 205/416] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:43.042203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.053755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d30588-b358-4bdd-b249-15d5fe13cee4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.087920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.098070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.098940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.099047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.099333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/groups/66d3070b6880441d9e737824541ebc4c/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.101898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a, group_id=66d3070b6880441d9e737824541ebc4c, role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.103694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:43.122509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 212/417] 10.222.0.61 () {58 vars in 1442 bytes} [Wed Aug 24 05:39:42 2022] PUT /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a/groups/66d3070b6880441d9e737824541ebc4c/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:43.123340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.173208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188f15c-7ebf-4ee4-b11f-1dbb21b219b5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.216981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.218100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.218602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.219075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] PATH_INFO: `/v3/projects/3d992e7dad954566a305a48a7522cc33` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.220770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] RBAC: Authorizing `identity:get_project(project_id=3d992e7dad954566a305a48a7522cc33)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.222618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:43.224880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 206/418] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/projects/3d992e7dad954566a305a48a7522cc33 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:43.231367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.258792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b237d-2abd-47b2-9619-318ab17ccdc9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.302077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.311523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.314054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.316424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.316899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.333595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:43.339409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:43.340360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:43.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:43.343935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 213/419] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:43.350075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.376195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249926b-0b3d-401a-a854-a6b3fcf6ea3f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.417327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.426805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.428220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.428577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.429223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] PATH_INFO: `/v3/projects/3d992e7dad954566a305a48a7522cc33/groups/340755191fa9451f9bda63bcc74cc833/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.433355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d992e7dad954566a305a48a7522cc33, group_id=340755191fa9451f9bda63bcc74cc833, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.435016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:43.453560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 207/420] 10.222.0.61 () {58 vars in 1442 bytes} [Wed Aug 24 05:39:43 2022] PUT /identity/v3/projects/3d992e7dad954566a305a48a7522cc33/groups/340755191fa9451f9bda63bcc74cc833/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:39:43.455087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.502244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff6c4-dc76-4e3a-a163-75f67cecc085 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.599067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebdeb3-3493-4222-b0b9-c16da3fd5c38 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.601362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.602434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.602726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.603010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.603704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] RBAC: Adding query filter params (name=member) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:43.604012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.605409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:43.627070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.630715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 214/421] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:43.637467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.641161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.641827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.642116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.642388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.671400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:43.682032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:43.682973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:43.683775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:43.688670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 208/422] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:43.693337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.813484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5036399-1748-4698-9f25-6210ed9c1742 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.818425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a049-3b29-47dd-9bc6-59e608a2e9e1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:43.838116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.858017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.859059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.859349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.859626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.860296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:43.860600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.862073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:43.871976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 209/423] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:43.878541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.893581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:43.895102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.895598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.896071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.957756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.988538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:43.990564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923c5e-7094-4bce-9508-1606ed4abdfd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.016901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16222a-3469-441b-96eb-f4511bbf470b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.057148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.058421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.058708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.059260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.114352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 215/424] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:44.120486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87ac3-184b-445a-88f7-cb612cc796ee None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.120819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87ac3-184b-445a-88f7-cb612cc796ee None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.121290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87ac3-184b-445a-88f7-cb612cc796ee None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.123096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 216/425] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:44.123847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87ac3-184b-445a-88f7-cb612cc796ee None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.139240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.141330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.143058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e4c14-3c18-49cb-9f75-1eb2335001c3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.189620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.241494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87ac3-184b-445a-88f7-cb612cc796ee None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.260172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 210/426] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:44.261379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.261673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.261974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.281286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:44.282626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.283487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.284133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.284412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.284908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.286919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.288344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.290333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 217/427] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:44.291112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.363703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 211/428] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:44.364557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.406147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.452302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6418b9-c103-4529-a173-67c9bb802673 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.502822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.523834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.524479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.524763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.525039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] PATH_INFO: `/v3/projects/ec9daf7e93b24960b835d213842a3424` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.527152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] RBAC: Authorizing `identity:get_project(project_id=ec9daf7e93b24960b835d213842a3424)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.528592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.530421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 218/429] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/projects/ec9daf7e93b24960b835d213842a3424 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:44.535607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.553336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff33c-f5db-4e85-959a-49be867ebed0 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.617423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.618312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.620167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.620453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.624388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.626183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.636099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 212/430] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:44.638339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.721040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c962e90-8b79-46ce-b710-2022d7f90c8c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.760357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.761532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.762070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.762569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.764085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.765968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.768502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 219/431] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:44.769756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.786417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42a66-ac67-4ab2-8566-40bd999220d7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.788396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.826456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.827077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.827363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.827704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.828546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=ec9daf7e93b24960b835d213842a3424) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:44.828901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.830439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.842557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 213/432] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:44.842557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:44.853586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.920959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7ac5-1cb9-4bbc-ac76-ba8e0fee832d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.959714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765efcb-bdb6-4caf-ba93-604dbd97aace None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.989150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.990174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.990627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.991046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.004900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.005598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.005923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.006202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.007192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=ec9daf7e93b24960b835d213842a3424) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:45.007508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.010564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.017642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:45.027412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:45.028355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:39:45.029111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:45.030034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 214/433] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=ec9daf7e93b24960b835d213842a3424&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:45.030115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 220/434] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:45.037644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.118838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.154764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e25-8758-4aa2-b878-cba3e0f97a99 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.193157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.193827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.194100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.194380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.195070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] RBAC: Adding query filter params (name=member) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:45.195381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.196791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53274c-d818-4bfd-9942-22d08e6445af None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.207285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 215/435] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:45.213438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.299997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.300189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc1cf-c3db-447e-9613-760ea06f1888 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.300453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc1cf-c3db-447e-9613-760ea06f1888 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.300737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc1cf-c3db-447e-9613-760ea06f1888 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.302838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 216/436] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:45.309126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.309411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.309690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.330951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62518-c8ab-4718-b048-4a615cd4cd5d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.334674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:45.335888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:45.378057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.378883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.379248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.379560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.417186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 217/437] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:45.461289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.463284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6132795-03e9-4e30-9dd9-771c3b304748 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.541224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.570119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 221/438] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:45.575990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.641387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.664370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02a6f8-52e3-4942-a8cc-9d9a3426cd47 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.664688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02a6f8-52e3-4942-a8cc-9d9a3426cd47 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.664941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02a6f8-52e3-4942-a8cc-9d9a3426cd47 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.666833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 222/439] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:45.673090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.673834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.674678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.685741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752eae1-22cd-44d0-b380-980b11b33450 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.698956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:45.700459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:45.728649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.729394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.729677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.730018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.731148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.732579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.734432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 218/440] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:45.735201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.776322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 223/441] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:45.777170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.847797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4b8c-5bb6-48af-9d50-21d1d81fba22 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.877198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.880104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1297fb-6274-49ed-80f3-8e2df170232e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.883455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.884254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.884652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.884975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.885299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.896540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:45.901211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:45.902291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:45.903060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 219/442] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:45.908320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.918927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.919671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.920023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.920309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.921426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.922896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.929213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 224/443] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:45.930072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.018433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d8bf-d223-433b-b149-bb1e6e9d7fd7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.039383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df13f5-d9ed-410e-84b6-9424f74ac453 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.055565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.056187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.056476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.056757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.057431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:46.057740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.059222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.067140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 220/444] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:46.067838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.074904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.075512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.075800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.076077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.076810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=18d95dfd99d24cd5b5cadd6cf43b7154, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:46.077121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.078574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.097952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 225/445] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=18d95dfd99d24cd5b5cadd6cf43b7154 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:46.097952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.128306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.131481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.190048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c389ab5-8641-4ff2-9721-c2a652ab75e3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.202788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078c76-f100-449a-845f-94ab54ff6552 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.231405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.232051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.232339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.232627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.244551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.245170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.245481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.245759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.246791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:46.252051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:46.252923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:39:46.254273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:46.254866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 221/446] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:46.259829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.326107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.327567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.369625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.382850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69625f-3dcf-45a9-9549-10b365ae1dec None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.399540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.423688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.425079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.425079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.425079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.425642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:46.426973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.427459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.437983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 222/447] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:46.444133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.453176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 226/448] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:46.459671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.543026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638fbc-8807-4d8e-9ca7-e015a4cdb0ce None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.556078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a3b1-034a-4a0d-ba18-95432ca601f9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.577484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.578136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.578422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.578701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.592791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.593423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.593711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.594018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] PATH_INFO: `/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.595130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] RBAC: Authorizing `identity:get_project(project_id=47ab0ebf8a9f4ea7ad52248c8c42fb4a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.596575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.598254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 227/449] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/projects/47ab0ebf8a9f4ea7ad52248c8c42fb4a => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:46.603883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.607923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.621191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.646306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.647748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.703408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da8f20-7830-4ea9-a50d-abe0eb1594ba None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.736104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.736735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.737020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.737301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] PATH_INFO: `/v3/groups/66d3070b6880441d9e737824541ebc4c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.738949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] RBAC: Authorizing `identity:get_group(group_id=66d3070b6880441d9e737824541ebc4c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.740400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.742301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 228/450] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/groups/66d3070b6880441d9e737824541ebc4c => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:46.750442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 223/451] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:46.750575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.752181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:46.817888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.826884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.847179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d24b1b-ae79-4521-a5b5-b9c0b5d378e2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.852477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69682e-b9a8-41a9-8a38-a5c4a7e38e3f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:46.880934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.881479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.881783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.882069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.882801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] RBAC: Adding query filter params (group.id=66d3070b6880441d9e737824541ebc4c, role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:46.883113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.884573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.885883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:46.886535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.886818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.887092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] PATH_INFO: `/v3/projects/3d992e7dad954566a305a48a7522cc33` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.888199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] RBAC: Authorizing `identity:get_project(project_id=3d992e7dad954566a305a48a7522cc33)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:46.889614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:46.890400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 229/452] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/role_assignments?group.id=66d3070b6880441d9e737824541ebc4c&scope.project.id=47ab0ebf8a9f4ea7ad52248c8c42fb4a&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:46.891242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 224/453] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/projects/3d992e7dad954566a305a48a7522cc33 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:46.896874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:47.001339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527690cf-fd48-47b1-8a66-d5c24be3ec28 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:47.035146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:47.035779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.036070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.036344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] PATH_INFO: `/v3/groups/340755191fa9451f9bda63bcc74cc833` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.037450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] RBAC: Authorizing `identity:get_group(group_id=340755191fa9451f9bda63bcc74cc833)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:47.038903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff1682-53d6-4846-91af-431d34edb70b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:47.040687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 230/454] 10.222.0.61 () {56 vars in 1180 bytes} [Wed Aug 24 05:39:46 2022] GET /identity/v3/groups/340755191fa9451f9bda63bcc74cc833 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:47.046302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:47.150577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ad9df-e2c0-4857-a727-fa821f6e99ed None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:47.185637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:47.186345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.186629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.186905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.187672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] RBAC: Adding query filter params (group.id=340755191fa9451f9bda63bcc74cc833, role.id=e815260061204037a403daee014c9531, scope.project.id=3d992e7dad954566a305a48a7522cc33) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:47.187983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:47.189414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06378f3e-5fad-443a-8298-e971922d55ad None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:47.195271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 225/455] 10.222.0.61 () {56 vars in 1376 bytes} [Wed Aug 24 05:39:47 2022] GET /identity/v3/role_assignments?group.id=340755191fa9451f9bda63bcc74cc833&scope.project.id=3d992e7dad954566a305a48a7522cc33&role.id=e815260061204037a403daee014c9531 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:49.423819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe85-c027-41fb-9bf5-1602d8f96905 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.424358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe85-c027-41fb-9bf5-1602d8f96905 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.424358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe85-c027-41fb-9bf5-1602d8f96905 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.425994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 231/456] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:49.431488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2b8f6-aa4e-480e-8bca-bcc05e6dd6a3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.431904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2b8f6-aa4e-480e-8bca-bcc05e6dd6a3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.432074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2b8f6-aa4e-480e-8bca-bcc05e6dd6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.446394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:49.458896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ffb2b8f6-aa4e-480e-8bca-bcc05e6dd6a3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:49.460095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ffb2b8f6-aa4e-480e-8bca-bcc05e6dd6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.545231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 226/457] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:49.578403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357be56-790b-4bf0-87eb-70ecb0e27bd2 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.578709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357be56-790b-4bf0-87eb-70ecb0e27bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.578962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357be56-790b-4bf0-87eb-70ecb0e27bd2 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.580387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 232/458] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:49.585990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98558d7-4f98-448a-9535-6d483604659e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.586282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98558d7-4f98-448a-9535-6d483604659e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.586557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98558d7-4f98-448a-9535-6d483604659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.614809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f98558d7-4f98-448a-9535-6d483604659e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:49.616015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f98558d7-4f98-448a-9535-6d483604659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.708688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 227/459] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:39:49.980435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357be56-790b-4bf0-87eb-70ecb0e27bd2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:49.985562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.056790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98558d7-4f98-448a-9535-6d483604659e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.134235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357be56-790b-4bf0-87eb-70ecb0e27bd2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.179049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.192102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.193154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.193577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.194104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.206144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.207920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.215724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98558d7-4f98-448a-9535-6d483604659e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-4927a8db-ec4e-4053-bde3-58fd6b71626e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:50.223581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:50.224578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:50.225388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:50.225388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:50.225388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:50.225388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 233/460] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:50.226544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa53b-06e5-47c8-baec-49d05fb31bd2 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.226830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa53b-06e5-47c8-baec-49d05fb31bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.227104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa53b-06e5-47c8-baec-49d05fb31bd2 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.228449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 234/461] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:50.233427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb08d-186a-43d7-8cf5-6d33e80f4b4b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.233924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb08d-186a-43d7-8cf5-6d33e80f4b4b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.234213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb08d-186a-43d7-8cf5-6d33e80f4b4b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.235680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 235/462] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:50.236533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fb08d-186a-43d7-8cf5-6d33e80f4b4b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.257712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.258385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.258673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.258949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.269820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.271294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-08dbddc8-05f7-4fb6-a9eb-600790f5d8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:50.294343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:50.295318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:50.296120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:50.296120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:50.296120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:50.296120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 228/463] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:50.297792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.298191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c4d78-7d08-4420-ab7b-d0a44f2333ce None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.298639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c4d78-7d08-4420-ab7b-d0a44f2333ce None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.299022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c4d78-7d08-4420-ab7b-d0a44f2333ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.322189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4d6c4d78-7d08-4420-ab7b-d0a44f2333ce None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:50.323400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4d6c4d78-7d08-4420-ab7b-d0a44f2333ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.344802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fb08d-186a-43d7-8cf5-6d33e80f4b4b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.381160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.382184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.382323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.382549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.383192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:50.383560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.384893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.396833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 229/464] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:50.397367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 236/465] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:50.398621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.404636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.405098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.405526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.425555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:50.426807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.485355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.518177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 230/466] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:50.519895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.533271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b4fa-0ef9-4776-a534-0def6893039c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.558745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.587748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.588425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.588714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.588995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.589643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:50.589986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.591685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.603577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 237/467] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:50.609815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.716912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413aebf-d937-4a6c-a2c1-6d3303713740 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.751489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f929-bc5b-4a74-a2de-af87e35fbf5d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.758053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.758675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.758956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.759231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.759891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.761337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.790438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 238/468] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:50 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:50.791296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.794988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.796210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.796738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.797278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.798447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.800670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.839688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 231/469] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:50 2022] POST /identity/v3/users => generated 246 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:50.859762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.919235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.949709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f845-1c8a-4b2e-a7ab-e5e1df47af6d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.996058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.997172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.998683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.999255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.999747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.017038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.019096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:51.036196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:51.037168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:51.038038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:51.038038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:51.038038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.039902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 239/470] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:51.046309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.086191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90d7a-6c28-4356-9429-52769d5acdb3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.135723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.136617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.136996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.137351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.151188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.152897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.159431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-ae041689-52eb-44df-a48f-50a252bba4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:51.168837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:51.169800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:51.170809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:51.170809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:51.170809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:51.170809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 232/471] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:51.175921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0716f-ecdc-4bad-9c53-7e42bc4e6f1c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.176319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0716f-ecdc-4bad-9c53-7e42bc4e6f1c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.176742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0716f-ecdc-4bad-9c53-7e42bc4e6f1c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.178488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 233/472] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:51.181946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0716f-ecdc-4bad-9c53-7e42bc4e6f1c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.182262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c4b46-d59f-4ae8-bec4-ff7352e76216 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.224426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.225189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.225470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.225760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.226696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:51.227011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.228383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9087-8914-40fa-8642-2ce65147d09b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.242260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 240/473] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:51.246895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.246895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.246895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.265145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:51.266656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:51.291263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.312304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0716f-ecdc-4bad-9c53-7e42bc4e6f1c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.352574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.352830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 241/474] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:51.353437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.353853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.354235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.354345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.355192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:51.355774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.357460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.372520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 234/475] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:51.381027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.500867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.556359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5488ff-f252-4bb0-a2c4-cdf81a0c4942 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.585496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90a0c-8c41-4e9b-b276-041736abf192 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.631522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.632177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.632463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.632740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.633395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.634883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.639261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.639892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.640181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.640462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.641110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.642575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.662061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 242/476] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:51.663234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.667920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 235/477] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/users => generated 249 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:51.795020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5edf24-e3a7-42cf-bf72-e88c7f48561c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.828566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.839175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.839808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.840094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.840371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.841050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.842493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:51.856788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.sql.core [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:39:51.856788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:39:51.856788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [parameters: {'id': '71d135b3c76944eba544d17021156544', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:39:51.856788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application result.read() Aug 24 05:39:51.878707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:39:51.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application yield resource Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise self.value Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application session.commit() Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:39:51.881924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:39:51.883941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:39:51.886000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application result.read() Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:39:51.887974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [parameters: {'id': '71d135b3c76944eba544d17021156544', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:51.889834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:39:51.899429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:51.901320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 243/478] 10.222.0.61 () {60 vars in 1131 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:51.901451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.901451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:52.022984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc28b03-a749-4fd7-860b-4affbb6b5f5b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.061155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.062171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.062649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.063146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.075233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-47640e8e-3097-4744-8adb-c99467dfcc06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:52.080693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:52.081561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:39:52.082392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:52.084408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 236/479] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:39:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:52.089880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:52.245736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce5d5a-79af-4ce9-8fd5-e529051b4b0a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:52.290717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:52.291722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.292217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.292698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.293559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:52.294083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:52.295702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1043a9-3e82-46c1-ac44-c8b6a527f6fd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.309230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 244/480] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:53.095155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec60f1-e740-458d-80b0-84f0cb7e00fa None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.095668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec60f1-e740-458d-80b0-84f0cb7e00fa None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.095745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec60f1-e740-458d-80b0-84f0cb7e00fa None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.097255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 237/481] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:53.103450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2a0e-bc22-472a-8f54-b22505f6ca8a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.104416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2a0e-bc22-472a-8f54-b22505f6ca8a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.104914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2a0e-bc22-472a-8f54-b22505f6ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.125545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-080a2a0e-bc22-472a-8f54-b22505f6ca8a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:53.127148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-080a2a0e-bc22-472a-8f54-b22505f6ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.203225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:53.225170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 245/482] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:53.337358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f95a-2020-4615-9ddf-54e955b233ba None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.337679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f95a-2020-4615-9ddf-54e955b233ba None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.337982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f95a-2020-4615-9ddf-54e955b233ba None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.339434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 238/483] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:53.344920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.345306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.345552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.374795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:53.376040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.448757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 246/484] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:53.580322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f95a-2020-4615-9ddf-54e955b233ba None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.663314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:53.716384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f95a-2020-4615-9ddf-54e955b233ba None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.766476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.767132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.767414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.767693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.782605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:53.788334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:53.789177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:53.789974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 239/485] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:53.795649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.927983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.937458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e16d7-96f5-43e9-8b0f-56ac1f4eb21a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.967636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.005969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.006978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.007269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.007794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.008480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:54.008786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.010451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a6cf-8400-420d-b4a1-f31d9539a220 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.021358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 247/486] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:54.023228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aafab-1357-46a2-9b1a-c469a283cd95 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.023516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aafab-1357-46a2-9b1a-c469a283cd95 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.023790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aafab-1357-46a2-9b1a-c469a283cd95 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.025790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 248/487] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:54.030689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aafab-1357-46a2-9b1a-c469a283cd95 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.059161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24795-9870-4459-9108-205ec8797735 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.083990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.097429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.099265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.099741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.100289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.113117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-eb485da2-a352-4aa5-8f8b-3bee85ac7d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:54.119163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:54.120082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:54.120872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:54.123578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 240/488] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:39:54.124962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.125527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.126046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.145485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:54.147032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.155459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aafab-1357-46a2-9b1a-c469a283cd95 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.192610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.193158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.193438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.193710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.205304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.206981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:54.225805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:54.227153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:54.227960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:54.227960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:54.227960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:54.227960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 249/490] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:54.227960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.228221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 241/490] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:54.230624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.290157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.404384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6b23-b299-49d4-9d23-af74fac3250d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.404926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3055420-9c82-44d4-8173-e96099957c9d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.424126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.448669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.449210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.449497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.449789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.450593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:54.450901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.452396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f9776-3acf-4559-82c3-fbc813fcaa71 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.453997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.455114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.455469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.455885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.457469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:54.457874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.459321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.465386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 250/491] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:54.466699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1b14-d44f-4793-8ac2-59b7f6c1e5c4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.466990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1b14-d44f-4793-8ac2-59b7f6c1e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.467273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1b14-d44f-4793-8ac2-59b7f6c1e5c4 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.472846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 251/492] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:54.474922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.475320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.476426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.479587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 242/493] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:54.480930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.510563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:54.512281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.602057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 252/494] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:54.602057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.612416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae701-2ddc-49ec-b47e-b35e1805c403 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.626376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.663228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.664423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.664860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.665836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.682206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.683954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:54.704266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:54.705141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:54.706967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:54.706967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:54.706967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:54.706967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 243/495] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:54.711041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.726955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd61921-cd0a-4939-b739-27cec9ab1549 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.739231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.777064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.778412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.779119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.779544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.790171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.791847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:39:54.810416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:54.811378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:39:54.812256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:54.814919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 253/496] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:54.816511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.824612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c34f1-748c-4d0f-a41b-306990e51910 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.862606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.863257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.863540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.863813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.876152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:54.882327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:54.883197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:54.883950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 244/497] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:54.884589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.921333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.942723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d023c-67ff-4bfb-909f-3d303c08b3b4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.977825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.978192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.978806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.979089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.979363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.980128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:54.980548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.982649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.996523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 254/498] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:54.997190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.998563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b52a-7f02-453d-83c9-0107298d4710 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.037611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.038258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.038554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.038835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.039566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.039962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.041415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.077837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 245/499] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.078688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.096293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58b63-c022-442e-9981-28562e666f68 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.130754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.131391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.131677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.131957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.141976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:39:55.147151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:55.147992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:55.148763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 255/500] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:55.149592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.153551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.185567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20950f0-1333-4757-95ed-528c650b95d7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.219660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.220297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.220585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.220863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.221560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.221903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.223302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a579097-7b41-4242-9b4e-100ac769fddc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.231407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 246/501] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.232512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857400e-7472-4544-acc8-bfd70df5b03f None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.232804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857400e-7472-4544-acc8-bfd70df5b03f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.233086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857400e-7472-4544-acc8-bfd70df5b03f None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.234321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 247/502] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:55.235023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857400e-7472-4544-acc8-bfd70df5b03f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.238470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.253701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e861-88d7-43ef-b52d-3ae01cb0a95d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.287874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.288506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.288791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.289068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.296170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.297639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:39:55.309157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:55.310175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 256/503] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:55.311032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.341599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857400e-7472-4544-acc8-bfd70df5b03f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.371124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.375771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.376548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.376845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.377120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.410968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169059d-6067-4797-82a7-b711b84395f3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.444264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.444874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.445000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.445162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.445443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.446150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.446386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90210021-3cac-466e-8d37-87c9f2f13120 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.446489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.447817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.449019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.457205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 257/504] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.458052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.551402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 248/505] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:55.552657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.552948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.553228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.555597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6b7a0-1878-41b9-90c8-b6a8e5e06b4f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.571427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:55.572646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.579411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.590628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.591255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.591534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.591806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.602414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.603847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:55.618104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:55.619017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:55.619879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:55.619879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.619879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:55.619879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 258/506] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:55.620085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.656631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 249/507] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:55.656631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.681760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.721963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49ad3-1ae1-4aca-94c6-14420e66638b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.753007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd81c-19c4-44ba-885a-413fe0eeaeaa None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.757574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.758215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.758506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.758786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.759522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.759840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.761314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.788125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.788811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.789099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.789374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.802882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 259/508] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.802882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.804618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.806135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:55.821966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:55.822862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:55.823684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:55.823684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.823684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:55.823684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 250/509] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:55.823890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.836896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.915509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246323-26ac-4bd6-bedf-f7d5c79e8414 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.920152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.936420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c19e3-56b4-478f-bf48-20491ddb6845 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:55.950507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.951136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.951420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.951691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.961335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.962816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.968948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:55.969551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.969863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.970139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.970781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:55.971091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:55.973554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:55.978058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:55.979086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:55.979928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:55.979928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:55.979928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:55.979928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 260/510] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:55.980138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:55.991471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 251/511] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:55.991471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.066067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.081622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e212b39-fc62-4400-bddd-97188dcba1e2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.085337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931776f-a81f-423d-943e-9cee329e70d6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.115084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.115680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.115960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.116233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.119528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.120199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.120490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.120765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.121403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:56.121709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.123112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.134119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 252/512] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:56.134899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.144083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.187686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.189132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.234802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200462-8443-4f7c-9498-174cc6c93ea7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.267643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.268807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.269086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.269368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.269576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.279594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.281028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.285431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 261/513] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:56.286310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:56.297748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:56.298679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:56.300055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:56.300055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:56.300055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:56.300055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 253/514] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:56.300055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.359630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.387882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f397b-ad65-4e3d-b75f-94ecdf5907f6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.400554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec515d-442f-4a9e-b6a5-cae3215131fc None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.421753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.422407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.422690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.422965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.423604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:56.423902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.425350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.433317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.434036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.434320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.434594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.436391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 262/515] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:56.438594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.443181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.444625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:39:56.457830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:56.458866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 254/516] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:56.459740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.488169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.540979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0b5e-3d6e-4868-8cf1-3ed122f1b36a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.562302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f1dd-0b68-4b42-af0d-acc1801f61d3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.573465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.574119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.574401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.574678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.578680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.583020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.584476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:39:56.595348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:56.596936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:56.598140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 263/517] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:56.598820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.598820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.598988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.599064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.599064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.611468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.613640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:56.628143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:56.629093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:56.629939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:56.629939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:56.629939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:56.629939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 255/518] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:56.630161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.698696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea11982-58f1-4955-bf6d-5133df94abee None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.705746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.728396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c7e7-d98c-4717-a934-ba6e758f4ee2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.732788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.733393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.733676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.733979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.734619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:56.734922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.736406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.750001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 264/519] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:56.750588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.764420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.765055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.765344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.765622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.772260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.773702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:39:56.785845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:56.786648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:56.787460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 256/520] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:56.787907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.819384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.849353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea70e4-e49f-4855-9320-41aafce613e0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.883529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.884060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.884339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.884613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.885334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:56.885638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.887094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.888665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d011a-2a4d-4b90-ab70-e5c7fd8dc3b9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.903532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 265/521] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:56.904320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.928392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.928998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.929278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.929550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.930300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:56.930412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.930604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.932022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.949225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 257/522] 10.222.0.61 () {56 vars in 1139 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:56.950032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.005688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f085-e29d-49ee-a1ff-41c8ccceb417 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.038867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.039175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.039937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.040055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.040324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.040958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:57.041264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.042652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.050982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2890-3a6a-45ff-95c6-128b8d9c36df None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.053465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 266/523] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:57.054284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.089021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.089631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.089956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.090239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.090885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.092330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.113495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 258/524] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:39:56 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:39:57.114349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.151821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.170073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4495df-5552-421f-80c7-40d0b338f88a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.205156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.206504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.206892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.207172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.207888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:57.208198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.209663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.234525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 267/525] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:57.234525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.238698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6419f-57c6-442d-bb14-77ca992c550c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.280155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.281418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.281787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.300836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.353017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e926c-eae0-46f6-b4c2-1ecc77d2a24a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.359277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.360869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.397287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.397927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.398212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.398484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.417537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.468765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 259/526] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:57.468765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.493185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.494822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.514201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.577785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cc2c-7d9e-430a-ab37-4d112b7d5ead None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.609290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 268/527] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:57.609290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.618216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.618952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.619313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.619652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.626974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.629045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:39:57.641174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:57.642160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:57.642969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 260/528] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:57.644309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.666317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.723929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87106-cf7a-4f20-8437-66ea7adbb5dd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.747286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059be94d-8afa-486b-a6f3-e86b8ec181d1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.749622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.760207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.760821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.761106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.761387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.762152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=0ff470a005324829a2d9ada970436094) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:57.762467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.763952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.777810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 269/529] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/role_assignments?user.id=0ff470a005324829a2d9ada970436094&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:57.777810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.795197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.796005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.796362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.796715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.809269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.810937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:57.827777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:57.828963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:57.830043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:57.830043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:57.830043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:57.835414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 261/530] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:57.836416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:57.924036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363abf3-7ed0-4966-a30e-dce1c2e66f97 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.934146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:57.960276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a203b4e-dfb9-40a6-a371-38d020251ea8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:57.962503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:57.963214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:57.963564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:57.963911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:57.975197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:57.976836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:39:57.991755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:57.992651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:39:57.993453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:39:57.993453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:39:57.993453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:57.998115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 270/531] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:57.999048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.002178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.003721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.004210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.004703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.005602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.006157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.007861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.032603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 262/532] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:58.033976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.059154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.105257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8e1a-1388-47ec-b986-4ddd040cb22a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.149531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.150612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.150881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.151159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.151815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.152120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.154030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.160863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d522c6-5d2e-4535-a25d-a641881f7476 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.173112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 271/533] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:58.173112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.196680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.215904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.216931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.217420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.217936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.218835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.219412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.222311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.238286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 263/534] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:58.239076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.296445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb59e-6dab-445a-8262-42fed6b43e0f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.333836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.334788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.335275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.335750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.336689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.336901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.337815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.339844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.350791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 272/535] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:58.352780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.365248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a8ca-7d82-4141-990e-83dcd2ca49f0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.401682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.402340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.402626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.402904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.411311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.412637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:39:58.425898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:58.426783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:39:58.427600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 264/536] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:58.438057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.490733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.509197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3362-9028-4b3c-b765-97f2d8bb0a76 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.547472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.548497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.549012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.549540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.559815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.561620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:39:58.574813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:39:58.575676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:39:58.576478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 273/537] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:39:58.585735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.651589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e610-2ea6-48e6-83ab-b298c6fade9a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.717238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.717885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.718183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.718442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.719136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.719439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.720878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.738140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.747278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72868-8a73-4adc-9850-3b204807bd28 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.754639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 265/538] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:39:58.760475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.803079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.803702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.803984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.804264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.804963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.805270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.806725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.834203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 274/539] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:58.839820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.850121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.870488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639388b-e2c4-41e6-b69f-5b22cb19bd71 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.954858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21fb2-eae0-4b14-9e3c-c754f8a87956 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.979015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.979638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.979921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.980189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.980929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=6ccf6d1dd8cc49b385c569206fcfdbe4) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.981240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.982700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674663fe-def2-4a12-9e0a-979e28301b62 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:58.990501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.991108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.991388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.991663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.992388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=1e4d0e7360db4d7db2bfe7ef1b0c2aee) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:39:58.992777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:58.994234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb6387-83ee-4fba-97c3-5785810d1308 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.000252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 275/540] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/role_assignments?user.id=1e4d0e7360db4d7db2bfe7ef1b0c2aee&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:59.001896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 266/541] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/role_assignments?user.id=6ccf6d1dd8cc49b385c569206fcfdbe4&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:39:59.344560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7f02-5005-4145-8f4e-63819bc95027 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.344910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7f02-5005-4145-8f4e-63819bc95027 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.345099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7f02-5005-4145-8f4e-63819bc95027 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.346821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 276/542] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:59.352025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e262c-c16e-4689-862e-9c692c7c705b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.352466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e262c-c16e-4689-862e-9c692c7c705b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.352559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e262c-c16e-4689-862e-9c692c7c705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.378975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e65e262c-c16e-4689-862e-9c692c7c705b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:59.380161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e65e262c-c16e-4689-862e-9c692c7c705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.456601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:59.468315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 267/543] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:39:59.790016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366645d4-5611-4db5-a0d6-01f256c110ea None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.790518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366645d4-5611-4db5-a0d6-01f256c110ea None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.790614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366645d4-5611-4db5-a0d6-01f256c110ea None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.792154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 277/544] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:59.797579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:59.797902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:59.798178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:59.822711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:59.823898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.892623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366645d4-5611-4db5-a0d6-01f256c110ea None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:59.904038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 268/545] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:00.006962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.051543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366645d4-5611-4db5-a0d6-01f256c110ea None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.099871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.100511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.101036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.101318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.115843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:00.120887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:00.121730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:00.122513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 278/546] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:00.127949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.190442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.297299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53103fd-87d5-44d0-a950-d8437010e3b5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.326450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.338216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.339139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.339621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.340094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.340962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:00.341483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.343392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.355798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 269/547] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:00.362164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.379385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5738e-4e4d-472d-bdf7-11b8394c1c78 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.431817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.451220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.451872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.452153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.452427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.475284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:00.486879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44c06a-5dcf-45a0-88f7-8f1c8b6a0155 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:00.488832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:00.489672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:00.490471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:00.493545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 279/548] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:00.506299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.552859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.552859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.552859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.553166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.578831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.581993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:00.604619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:00.605552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:00.606983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:00.606983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:00.606983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:00.607742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 270/549] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:00.614282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.667086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.714116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb1bf2-b9d1-4bed-b999-8722ff6e8322 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.747431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5b5d8-5003-4097-a677-b64767d63703 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.787089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.788177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.788667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.789147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.790044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:00.790568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.791813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.792425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.792709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.792984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.793588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.793689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:00.793964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.795316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399cf2-6be0-4c75-9f35-90e2aac5fd70 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.809243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 271/550] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:00.815562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.822964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 280/551] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:00.824315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0212-2d1f-4cfb-acc7-df8d10afb123 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.824602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0212-2d1f-4cfb-acc7-df8d10afb123 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.824877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0212-2d1f-4cfb-acc7-df8d10afb123 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.829862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 281/552] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:00.831067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba0212-2d1f-4cfb-acc7-df8d10afb123 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:00.894662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.923766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:00.931710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ca4b-b0ca-423c-be5b-01ead6a6733d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.964407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba0212-2d1f-4cfb-acc7-df8d10afb123 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:00.969696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:00.970459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.970841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.971240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:00.978973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:00.980534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-43678112-6136-4f48-8ad2-4bd6eed7ab96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:00.993532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:00.994716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:00.995892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:00.997390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 272/553] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:00.998656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:00.999125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:00.999511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.010127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.011007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.011480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.011944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.019225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:01.020527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.026072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.029273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:01.049742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:01.050865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:01.051843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:01.051843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:01.051843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:01.058590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 282/554] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:01.058838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.113932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 273/555] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:01.115813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.204588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465e0c9-0e92-4181-a706-14849d6bbdc8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.206853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.240597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.241216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.241502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.241857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.242596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:01.242960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.244468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889172-7fc7-4798-9e2a-032d35a81c0e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.253040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.263606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 283/556] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:01.269935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19863c-f495-4bbb-b2ff-c045215b7188 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.270230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19863c-f495-4bbb-b2ff-c045215b7188 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.270512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19863c-f495-4bbb-b2ff-c045215b7188 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.272045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 284/557] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:01.272761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19863c-f495-4bbb-b2ff-c045215b7188 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.274408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69bb7-7ba5-4f3d-8577-134169118de7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.316370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.316980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.317266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.317542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.318248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:01.318553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.319926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9eb6-b601-4872-b43e-b5d8cc4dc126 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.337796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 274/558] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:01.337796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.337796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.337796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.359161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:01.360478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.402899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19863c-f495-4bbb-b2ff-c045215b7188 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.437815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 275/559] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:01.437815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.445706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.447121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.447617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.448437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.502981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.514332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.536278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.537859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2949e3-f831-400c-8724-52d40b7fae98 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.542150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016fc55-95fb-4596-b3c8-09381b09e7ed None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.584664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.585311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.585593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.585911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.593041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.594532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:01.606827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:01.607738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 276/560] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:01.608648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.660427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 285/561] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:01.660427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e51a1-c1a7-4a20-98d7-b47e476c352f None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.660427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e51a1-c1a7-4a20-98d7-b47e476c352f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.660427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e51a1-c1a7-4a20-98d7-b47e476c352f None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.661888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 286/562] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:01.663025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e51a1-c1a7-4a20-98d7-b47e476c352f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.718002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46101-da46-4b15-ae8e-fbe6bb8da463 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.726057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.753060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.753700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.754018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.754299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.756307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.767155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:01.768951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e51a1-c1a7-4a20-98d7-b47e476c352f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:01.772497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:01.773552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 277/563] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:01.774416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.803826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.804436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.804720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.805001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.805730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:01.806425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.807865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf44fd1-36f7-4bb3-adee-eb1d4963c208 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.825045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 287/564] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:01.826308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.826603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.826883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.846362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:01.847565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.876315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97386c8a-f98c-44c6-b93e-0bc59d612de6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.909506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.910160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.910493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.910723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.914189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 288/565] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:01.915020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.930357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.931925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:01.947037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:01.947941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:01.953795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:01.953795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:01.953795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:01.953795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 278/566] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:01.953795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.970635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.998394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.027836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13771b-23de-4569-9ef0-c53ecb4c1d04 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.059898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffaaff-c499-4411-8b5f-c539452da208 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.064519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.065178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.065461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.065735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.078647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:02.085065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.086224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:02.087070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:02.087690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 289/567] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.089887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.097791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.098500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.098855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.099203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.099939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.100358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.102033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.115128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 279/568] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.115128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.202395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828e46-50db-4bd8-9381-3f9cfb744dfd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.211414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.217721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed84c7-d8b1-4868-a48d-989b934848d2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.227786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.238023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.238651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.238934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.239210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.248976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.250460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.253873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.254483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.254764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.255040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.255704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.256009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.257344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:02.265128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.266135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:02.266993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:02.266993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.266993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:02.266993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 290/569] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.266993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.271284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 280/570] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.272091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.368052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14668-18fa-4fc5-b872-a017b083d01f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.369757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792079-07a7-4895-9409-0276104262c5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.403559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.404197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.404486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.404759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.406839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.407439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.407720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.407992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.409284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.409588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.410997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.415165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.416580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.418735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 291/571] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.419509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:02.435577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.436714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:02.437628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:02.437628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.437628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:02.438034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 281/572] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.438724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.446511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.460737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.521877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39158905-5f55-4df4-b1bd-1742f748babb None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.541218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25ec2-0ea8-492d-a273-124366912376 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.555037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.555660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.555940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.556214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.566083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:02.571089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.572186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 292/573] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.573077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.576899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.577514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.577819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.578104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.578783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.579089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.580961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.592708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 282/574] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.593319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.658116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.674916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.676589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197f17-a4af-4fb0-93be-5729369778aa None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.694610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2be871-5715-4659-9055-5ded00cacf87 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.708596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.709221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.709507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.709810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.716365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.717738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.728193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.728817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.729099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:02.729342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.730270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:02.731115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:02.731557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.731626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 293/575] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.731626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.744567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.746052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:02.761226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:02.762358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:02.763412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:02.763412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:02.763412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:02.763412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 283/576] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:02.763412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.835228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb7a8-fe90-4ff2-81fa-eab986fde849 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.859026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46079-bdf0-43e1-a52a-308621b3fc15 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:02.867871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.868472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.868753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.869027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.869669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.870015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.871341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.882614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 294/577] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.883402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.885860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.889253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:02.894626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:02.895236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:02.895520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:02.895796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:02.896454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:02.896762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:02.898151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:02.906115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 284/578] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:02.906802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:02.981798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274cb8-a2ad-4ad2-a840-55cbdff45932 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.006275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373754d-8cb9-4658-b0f9-f4ba8a42a77f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.015169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.015795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.016080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.016354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.023306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.024738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:03.036057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:03.036902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:03.037791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 295/579] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:03.038274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.044850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.045459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.045741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.046049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.046737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.047042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.048462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.060753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 285/580] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.061536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.104568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.115717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.142692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca0b4-ffd5-4f24-9a85-61c32edb972b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.159473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcf08-b169-4da0-84a5-b212bceb03ef None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.176866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.177473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.177759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.178068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.178713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.179020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.180380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.191225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 296/581] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.191598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.192004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.192254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.192503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.192774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.202455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.203929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:03.215521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:03.216558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 286/582] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:03.217589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.295440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000556f8-1008-4f95-b5ba-95a9fb2da8fa None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.316348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6156-aac2-469a-9e97-94d30e67590a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.316867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.328853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.329472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.329752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.330051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.331114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.340797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.342263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.352646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.353242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.353524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.353817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.354518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.354804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.356341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:03.356932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:03.358017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:03.358859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:03.358859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:03.358859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:03.358859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 297/583] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:03.358859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.372404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 287/584] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.373270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.462787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be7e3-be57-4bf2-a4e2-822c1a8456fa None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.473258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9e64d-95a5-46dc-9572-e7e1d31c1795 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.495156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.495756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.496044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.496322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.497048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=d978a00f91b1435f9662492df2d52fd0) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.497360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.498832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.504844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 298/585] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/role_assignments?user.id=d978a00f91b1435f9662492df2d52fd0&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.505615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.507695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.508336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.508618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.508895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.517293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.519468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:03.532774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:03.533903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 288/586] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:03.534813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.556303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.577827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.629967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2261da-94e7-4661-9e00-381774602ca1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.654174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0bca-5cc6-4a12-b004-64a98b97ddc6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.671347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.671969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.672251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.672524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.673258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.673563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.675056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.691173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.691837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.692133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.692412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.693024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.693326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.694365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 299/587] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.694994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.699512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.716638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 289/588] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.716638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.794188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.803720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0564-b68a-4097-8de5-276af30457b3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.815633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:03.822952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19673ef9-d304-407e-9c85-055e3edbc212 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:03.841963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.842623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.843015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.843295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/0ff470a005324829a2d9ada970436094/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.856927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:03.857539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:03.857855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:03.858123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:03.858851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:03.859157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.859706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=0ff470a005324829a2d9ada970436094, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:03.860583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.861438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:03.875895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 300/589] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:03 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/0ff470a005324829a2d9ada970436094/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:03.876544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:03.885927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 290/590] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:03.887764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.015299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b828-23b3-443c-8fc3-0c706f336511 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.024864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218b76-c3bb-45ee-beea-0c1a508dd9d9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.058223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.058792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.059080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.059359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.070055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.070369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.070693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.070980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.071316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.071886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.082427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.082872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.084305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:04.091018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.091928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:04.092774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:04.092774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.092774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:04.096190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.097273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:40:04.098221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:04.098735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 301/591] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.098805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 291/592] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.098883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.098952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.119001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.215580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5de0-c644-4ebb-87e8-ef36c284c49a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.230909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2a7-dc95-4c37-a26c-558c90cf792f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.255415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.256055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.256427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.256712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.267852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.269315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.275035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.275685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.276427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.276710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.277398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.278216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.279875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:04.285102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.286418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:04.288279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:04.288279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.288279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:04.292678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 302/594] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.293628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.296782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 292/594] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:04.297636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.352491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.398159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.407498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f937-d24f-410e-8b84-9cfeb33da469 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.428254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd966a7-daaa-4b9e-9f9d-e1db5e569e2a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.446247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.447185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.447725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.448183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.449104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.449594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.451243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.463408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.464020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.464302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.464573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.465218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.465521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.466925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.473442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 303/595] 10.222.0.61 () {56 vars in 1139 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:04.474694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.483741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 293/596] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:04.484906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.582854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2257-9d7c-4760-9c36-73e0b789685e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.586823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3565-00cc-48f4-9db7-df8912efd7df None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.594556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.622475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.623138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.623423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.623701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.624773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.625652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.626255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.626733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.634196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.634447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.635515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.636702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.636812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:04.650004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.650878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:04.651820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:04.652265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.653079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:04.653967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:04.653967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:04.653967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:04.653967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 294/597] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.653967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.661857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 304/598] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.663846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.769657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fafd3-ec17-4a81-850d-9e90d2493d67 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.778354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb72e5-d6dc-4c67-823e-fde2f3f4c682 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.806232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.807290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.807781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.808260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.809139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.809649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.811250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.818189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.818822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.819104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.819377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.829578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.829578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.830013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 305/599] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:04.831646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:04.843175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:04.844243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:04.845308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:04.847614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 295/600] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:04.850181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.870881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.911076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.952825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6738-d8f4-4fdc-88b3-cd87de0061b9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.983799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6c23-a9e0-43d4-bef8-1e1f7d9b12ab None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.996370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.997187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.997619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.998073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.999039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:04.999589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.001155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.015188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 306/601] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:05.016330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.029154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.030086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.030432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.030805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.038594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.040340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:05.053998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:05.054934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:05.055778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 296/602] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:05.057073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.116522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.130482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624a17-f93f-48c1-a342-ddbf3729cc84 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.168280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87090cc-f054-409f-9929-a5e3bb6bfb3c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.170253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.171591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.172461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.172885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.173270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.174377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:05.174898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.176404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.192974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 307/603] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:05.193750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.213382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.214628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.214982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.215606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.234022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=640894aa402744af861080d8d0d80f66, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.235674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.250656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 297/604] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:05 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:05.251841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.310356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98974cb-6e8e-4c5a-9417-8dd2906717b2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.348132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.348762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.349142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.349420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.350150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:05.350457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.352273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.369912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 308/605] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:05.370362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0076a-5356-4d38-8df4-50552f4b1d99 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.372746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:05.384509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.413400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.414797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.415311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.415766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/6ccf6d1dd8cc49b385c569206fcfdbe4/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.433840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=6ccf6d1dd8cc49b385c569206fcfdbe4, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.435259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af329c04-f531-4ab5-bd79-1f1a753c85e7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.455726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 298/606] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:05 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/6ccf6d1dd8cc49b385c569206fcfdbe4/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:05.457713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a308f1-6a1e-4678-96e7-80f387264b05 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.458281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a308f1-6a1e-4678-96e7-80f387264b05 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.458571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a308f1-6a1e-4678-96e7-80f387264b05 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.460544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 299/607] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:05.466165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.466807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.467290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.476433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:05.488599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:05.490194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:05.492904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb17c5d-b323-4602-868b-13c422ffb40c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:05.539866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:05.541008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:05.541605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:05.542167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/1e4d0e7360db4d7db2bfe7ef1b0c2aee/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:05.573571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=1e4d0e7360db4d7db2bfe7ef1b0c2aee, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:05.575370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 300/608] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:40:05.575666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:05.598168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 309/609] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:05 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/1e4d0e7360db4d7db2bfe7ef1b0c2aee/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:05.872420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.002144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83283e4-aa20-47d7-b58d-b1705a040cd2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.055858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.056904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.057408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.057926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.060222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.071755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-86919553-72c1-4fa2-9342-e2ea689bedae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:06.076558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:06.077666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:06.078718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:06.080700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 301/610] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:06.086896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.093164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b383a4-bae2-4820-bd25-1e1a7044ca76 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.093450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b383a4-bae2-4820-bd25-1e1a7044ca76 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.093729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b383a4-bae2-4820-bd25-1e1a7044ca76 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.095162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 302/611] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:06.101267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.101553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.101990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.123725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:06.124833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:06.193910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.231038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 303/612] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:40:06.232577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6b6f-cb1c-4310-844b-fae660d7adb6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.289196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.289830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.290120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.290395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.291066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:06.291371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.292734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.301332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 310/613] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:06.306526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.435102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8dcb-d30f-42fc-ba3c-1226f3d5f594 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.460529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.478133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.478771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.479050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.479321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.490280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.491731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:06.510625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:06.512782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:06.514875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:06.514875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:06.514875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:06.518220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 304/614] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:06.518387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.590542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.688872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519692f-ba2e-4ef3-a57d-ee6313d5f23b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.712436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.731163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.731783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.732069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.732344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.732993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:06.733297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.735197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.758826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 311/615] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:06.761814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.769314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32cf5e-f8c0-4310-97eb-8e8b92526dae None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.845144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.845882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.846171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.846448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.871312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:06.881446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:06.882365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:06.883175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 305/616] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:06.888253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:06.931136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1658baf-1688-473e-b5db-4b176fee1a99 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:06.966027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:06.966586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.966874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.967153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.974211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:06.975912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:06.982756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:06.989111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:06.990227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:06.991150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 312/617] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:06.998234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.043222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.104780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9167-7573-448d-afb4-75b75ff9d5a5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.140564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.141252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.141541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.141856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.142644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:07.142954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.144378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.162836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 313/618] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:07.168345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.171962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da85924-14b3-40a8-b2b2-55a658e46be3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.258464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.259095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.259383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.259667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.260345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:07.260651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.262042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.271345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca092-bac0-4119-b389-f97b4b3022d3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.274317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.281099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 306/619] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:07.287016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.331133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.331773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.332056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.332334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.358300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.359750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:07.385184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:07.386375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:07.387287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:07.387287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:07.387287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:07.387287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 314/620] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:07.392994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.443659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e652ca-8ef1-4307-8f40-658f29816cde None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.446303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.483253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.483253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.483253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.483253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.493685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.495664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:07.509201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:07.510357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:07.511384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:07.511384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:07.511384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:07.511384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 307/621] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:07.516056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.610218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cbba-0aab-4020-912d-ff735126c67b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.675558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.676175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.676456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.676732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.677383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:07.677685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.679744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.690850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605c65-10a1-46c1-a1fd-24cfb6acff56 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.693666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 315/622] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:07.704228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.721442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.737319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.737980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.738329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.738761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.739757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:07.740339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.741927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13fe5e-2d80-43d2-b7b4-56aa23765054 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.757483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 308/623] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:07.758877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823a31-6b2e-4ea2-ba97-36c66161a844 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.759273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823a31-6b2e-4ea2-ba97-36c66161a844 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.759502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823a31-6b2e-4ea2-ba97-36c66161a844 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.760966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 309/624] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:07.766126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823a31-6b2e-4ea2-ba97-36c66161a844 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.781994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.840992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190452-ce65-410c-a8c7-b92618fb8386 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.876122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.876754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.877332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.877332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.884173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.885577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.886919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823a31-6b2e-4ea2-ba97-36c66161a844 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-7461671e-6bc6-4947-82db-fca110721099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:07.898529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:07.899456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:07.900329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 316/625] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:07.900811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.900877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.901425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.919084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:07.920257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.928185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.928816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.929096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.929368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.936979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.938446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-4f6fcfef-d867-45d3-b231-bf1f35b9d5bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:07.950843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:07.951949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:40:07.953137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:07.957375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 310/626] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:07.958645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed278f-9cf1-407a-80a0-a82c57efac54 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.958926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed278f-9cf1-407a-80a0-a82c57efac54 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.959210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed278f-9cf1-407a-80a0-a82c57efac54 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.960710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 311/627] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:07.961413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed278f-9cf1-407a-80a0-a82c57efac54 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.993431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.002471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 317/628] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:08.002471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.056259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.091218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed278f-9cf1-407a-80a0-a82c57efac54 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.115070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a0833-4475-4fb4-81f2-20691b5d04cf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.127710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.128395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.128602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.128877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.129564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:08.129904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.131314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0460733-63e5-496a-814f-09680eb2d4d1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.148525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 312/629] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:08.149802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.150081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.150349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.152920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.153530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.153854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.154134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.154868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:08.155175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.156680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade981e-6c19-40f1-b674-64f4f51a31fa None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.167664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:08.168834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 318/630] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20ebe-2f36-4a23-89c3-b32f51198a57 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20ebe-2f36-4a23-89c3-b32f51198a57 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20ebe-2f36-4a23-89c3-b32f51198a57 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 319/631] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:08.178352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20ebe-2f36-4a23-89c3-b32f51198a57 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.240249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.258042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 313/632] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:08.258862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.288546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20ebe-2f36-4a23-89c3-b32f51198a57 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.322551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.325181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.325876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.326166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.326433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/d978a00f91b1435f9662492df2d52fd0/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.340807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=d978a00f91b1435f9662492df2d52fd0, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.342757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97beb7-432f-4cd5-982c-d21e20e32db1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.365793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 320/633] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:08 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/d978a00f91b1435f9662492df2d52fd0/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:08.365793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.365793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.365793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.378936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d6d50-bab0-43ee-9acf-8ca0533ed9e7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.382905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:08.384317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:08.419082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.419713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.419996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.420267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.488108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 321/634] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:08.490075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.503942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.505614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.553184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.585745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.624116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aeb4d-3fef-42c5-9fc9-c43b1ec727a8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.632890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 314/635] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:08.633954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.676408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.677046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.677330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.677605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.691455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:08.697945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:08.699029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:08.700018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 322/636] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:08.700836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.746236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7907-5bba-480d-8a00-aa36001e62cf None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.788424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.789312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.789312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.789601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.801074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:08.806303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:08.807367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:08.808162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 315/637] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:08.809125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.825310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.829609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba37f4-9505-44db-836e-980af1054c8a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.834032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:08.864923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.865471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.865778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.866055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.876383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.877921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:08.891580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:08.892568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:08.893418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:08.893418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:08.893418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:08.897299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 323/638] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:08.898076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:08.921357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78dae-5483-437a-9c09-4de101fcde4d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:08.962078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:08.963025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:08.963490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:08.963956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:08.964705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:08.965013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:08.966669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:08.980185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 316/639] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:08.980185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.002685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a5db-10a2-4c14-b387-9719d62e61cd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.038897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.039535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.039818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.040096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.050775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:09.056067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:09.056955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:09.057798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 324/640] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:09.058510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.072409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.073927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.096514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7422-9fbd-44df-ab1b-781a90df0873 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.132697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.133233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.133648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.133940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.134726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.135033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.136390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.150050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 317/641] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.150050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.175365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928c83-3404-45a5-903c-de3dcdc33683 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.208176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.208777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.209061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.209338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.210003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.210306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.211664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.223420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 325/642] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.224188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.258792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4e053-dcd1-4bdf-8e19-21a42d8e96c5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.293035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.293668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.293978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.294254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.296940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.305364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.307206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.309710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:09.322328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:09.323320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:09.324182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:09.324182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.324182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:09.324182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 318/643] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:09.324411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.338691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a782-873f-49f8-9cc6-f381f092a66b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.375827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.376441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.376722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.377024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.377686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.378024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.379388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.387830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 326/644] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.388624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.430738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f336-0ae7-4c0f-a88f-e2957b2b1c5d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.471847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.472487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.472767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.473040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.487186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.488664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:09.504139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:09.505579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:09.506676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:09.506676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.506676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:09.506676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 319/645] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:09.506676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.516341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349124f0-1c3a-444e-8076-4630e3733378 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.552772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.558108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.558929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.559212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.559532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.560730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.569086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.569086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:09.579727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:09.581165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:09.582557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:09.586164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 327/646] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:09.586907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.617059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad3e0-393b-4525-8ea1-3a8f1d09bff1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.653873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.654757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.655242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.655878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.657211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.657728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.659717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.675678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 320/647] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.676787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.690340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca75fd-9a28-44b5-b76b-089cd7ac6022 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.726342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.727076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.727360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.727644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.738524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.739960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:09.754771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:09.755709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:09.756555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:09.756555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:09.756555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:09.756555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 328/648] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:09.756791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.790901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3c626-c65e-4668-bd0b-1d04e8a1289a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.801266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.807675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.828229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.828846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.829132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.829410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.830142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.830449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.831857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.843619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 321/649] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.844440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.870033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a8463-3c96-4f85-8ae4-0d3d5c250df2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.904556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.905087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.905395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.905643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.906374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:09.906682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.908142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:09.925842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 329/650] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:09.925842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.947582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00572d0e-fcb3-4492-8870-ab579381a1b5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:09.988988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:09.989624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.989942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.990463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.997783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:09.999251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:10.010668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:10.011605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 322/651] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:10.012535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.038317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b4e7-f0cd-48bb-9904-df38567f390a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.041494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.042168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.079109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.079725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.080039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.080319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.081133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:10.081450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.083613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.096001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 330/652] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:10.097121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.121782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089fac-009b-4427-93e3-d4983e02aa26 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.157701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.158909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.159198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.159472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.167118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.168553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:10.180647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:10.181607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 323/653] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:10.187533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.216395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d56f4-c25b-48ac-81c8-12c1fb3f5002 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.253268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.253919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.254203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.254477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.255220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=0ff470a005324829a2d9ada970436094) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:10.255505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.256923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.262593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 331/654] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/role_assignments?user.id=0ff470a005324829a2d9ada970436094&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:10.263380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.296796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.298730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.313994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e06e08-7630-411a-b180-77600a388f3b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.357464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.358123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.358406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.358683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.359529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:10.359841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.361958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.381902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 324/655] 10.222.0.61 () {56 vars in 1137 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:10.382673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.388966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180ba8-4d8a-4e3d-b47e-087f2c5711bb None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.427448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.428000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.428285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.428551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.436632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.438092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-fab2e097-7be8-40c3-b991-13089bca6a8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:10.451102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:10.452051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 332/656] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:10.453668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c6ae-b983-4011-9237-4d71eba7cc45 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.454370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c6ae-b983-4011-9237-4d71eba7cc45 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.454370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c6ae-b983-4011-9237-4d71eba7cc45 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.455414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 333/657] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:10.455951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c6ae-b983-4011-9237-4d71eba7cc45 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.511498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5581e-46e0-4fad-a5db-b9b3d6126aa1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.553476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.554148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.554433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.554712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.555450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:10.555764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.557201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.561007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.578605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 325/658] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:10.580603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c6ae-b983-4011-9237-4d71eba7cc45 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.584226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.589111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.617444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.618080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.618370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.618649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.692365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a3f7e-9863-4985-94be-5cbb61bcaf81 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.695206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.696666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.731698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.732304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.732587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.732864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.733598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:10.733947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.735399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62419-5ee9-4d43-9b80-e09063b7beef None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.756840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 326/659] 10.222.0.61 () {56 vars in 1139 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:10.756840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.756840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.756840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.772713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:10.774029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:10.796823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.813805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 334/660] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:10.813805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.834515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.849806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 327/661] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:10.849806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:10.934650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c495e5-9067-46a2-9ce6-1150d29d8e11 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.973395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.974377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.974858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.975327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.982295 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa88d34-d55b-4fdd-9976-8188eef6bfe3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.031228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.032353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.032644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.032937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.036368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.050613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.052312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.101083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.112735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.114474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.178540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 335/662] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:11.182955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.224852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 328/663] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:11.224852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.281033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.294685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ae1d4-7887-4071-8899-b910390d6516 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.317319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.328121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e21c0-4213-4323-a0fa-555dc6de3cb0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.332731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.333368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.333653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.333960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.344113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.346212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:11.361482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:11.362548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:11.363391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:11.363391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.363391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:11.366677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.367121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 336/664] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:11.367728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.367825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.368023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.368302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.379643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:11.384352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:11.385427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 329/665] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:11.386307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.482364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0b1d-a3af-40bf-87bf-e9a6a952640a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.493650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77e37-1d78-4f7b-9887-26ce7452a1f5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.520544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.521448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.521740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.522056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.529695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.530916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.531196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.531467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.531562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.535572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.537227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.543017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.544472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:11.557473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:11.558392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:11.559248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:11.559248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.559248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:11.559248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 337/666] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:11.559892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:11.563788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:11.564723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:11.573461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:11.573461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:11.573461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:11.573461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 330/667] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:11.573461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.575673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.669211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66185c-8ab4-4335-a86a-537f3e9aca04 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.684141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548d9f-8443-44cc-9acb-5e77869b62f3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.704654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.705991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.706374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.706656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.707363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:11.707672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.709036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.725232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 338/668] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:11.725650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.725748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.725882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.738024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 331/669] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:11.738024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.784727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.815373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:11.834354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281bc60-ca36-4448-b83e-c8644331efd7 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.859242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7293e-8d40-46b2-b56a-17b27aac0ece None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:11.873099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.873900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.874192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.874542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.875258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:11.875631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.877642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.889573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 339/670] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:11.895292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:11.896142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:11.896820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:11.897170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:11.897510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:11.898259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:11.898628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:11.900053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:11.916681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 332/671] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:11.917637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.000660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d72f6b-a321-4f8b-ae78-683fc97acea8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.013669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.031269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99be69-640d-438d-bce5-e008cb720560 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.035761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.036517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.036806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.037134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.045079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.046658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:12.058250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:12.059204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 340/672] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:12.060645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.067575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.077541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.078206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.078492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.078764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.089650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.091116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:12.108469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:12.109575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:12.110496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:12.110496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:12.110496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:12.110496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 333/673] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:12.110496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.173391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9f2f-6923-405b-aa80-04766c94bcc8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.209859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.210597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.210933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.211213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.218230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.218667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254f4d-ebd9-4190-a33f-807ed8f8948d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.219727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:12.231916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:12.232831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 341/674] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:12.233986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.259004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.259640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.259921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.260197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.266775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.268406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.270103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:12.279941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:12.280996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 334/675] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:12.282098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.323820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.339151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eb2e2-d662-456e-9dc5-15c52dd8f286 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.376493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.378162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.378689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.379210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.380515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.381099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.383311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.384357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082804b-0cb2-4d65-9060-27965bda1758 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.395147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 342/676] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.395960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.419139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.419747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.420033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.420307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.420951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.421256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.422659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807af18-0e1f-43a7-931d-d908d9aea912 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.434581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 335/677] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.435726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111419cf-67bd-4237-b598-72c451f8584f None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.436014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111419cf-67bd-4237-b598-72c451f8584f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.436298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111419cf-67bd-4237-b598-72c451f8584f None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.437498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 336/678] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:12.438225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111419cf-67bd-4237-b598-72c451f8584f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.494799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.504083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3731c15-4b11-415d-a120-db38fc48aa4f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.537102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.539078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.539802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.540092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.540377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.541071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.541382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.542466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111419cf-67bd-4237-b598-72c451f8584f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.542847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.555281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 343/679] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.556112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.585435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.586076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.586358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.586633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.587332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.587638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.589071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.601018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 337/680] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.601850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.655769 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef329-1502-4e2a-aaa9-1408a397f287 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.689938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.690694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.691071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.691444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.692264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=6ccf6d1dd8cc49b385c569206fcfdbe4) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.692648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.694083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7b8c7-f093-49dd-8c02-941a56f3dc27 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.698746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b7489-3241-4f2a-97c9-ab9b5b10792a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.699563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 344/681] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/role_assignments?user.id=6ccf6d1dd8cc49b385c569206fcfdbe4&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.700744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.701034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.701310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.720040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:12.721864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.734500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.749872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.750640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.751002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.751354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.759998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.761596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:12.774476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:12.775472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:12.776429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:12.780690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 338/682] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:12.781505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.802854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.806282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 345/683] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:12.815670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.917948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e28f-9bd3-44e2-955e-716fb83beaf4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.936078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9a47-fc7c-47cf-a53e-b105f7e943d1 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.960118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.960989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.961272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.961549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.962692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.963004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.964518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:12.974054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 339/684] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:12.975238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.993331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.993998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.994280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.994553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.995303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=1e4d0e7360db4d7db2bfe7ef1b0c2aee) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:12.995613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:12.997120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.010645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 346/685] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/role_assignments?user.id=1e4d0e7360db4d7db2bfe7ef1b0c2aee&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:13.096558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.124737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcb26-3ad0-4e35-bab2-446544a03422 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.154361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.174550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.177679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.178444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.178709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.178991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.179891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:13.180213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.181743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.214892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 340/686] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:13.219414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.323564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1817-fc6c-4f76-8923-92df27695bcc None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.353355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce004cee-09e4-4d9d-b077-23fe75087147 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.360886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.361561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.361879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.362162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.376100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.378268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:13.393600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:13.394717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:13.395571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:13.395571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:13.395571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:13.396136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 347/687] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:13.398995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.399856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.400344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.400837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.401654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.415632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.481217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.482704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.586362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.588433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 341/688] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:13.594848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.656666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8c623-f343-46b9-9ebc-fae59089b5e4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.670397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.717984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.718602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.718894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.719177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.719948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:13.721098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.722224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.735319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 348/689] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:13.740829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.770038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1b9ac-5d64-4432-841c-16e4fd0a23d2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.833034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.834201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.834725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.835205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.848369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786945bb-5d48-4e4b-91b4-2f2dddca4030 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:13.858854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.860314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.874190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:13.885354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:13.885942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:13.886240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:13.886534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:13.889818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:13.890188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:13.891058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:13.891928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:13.891928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:13.891928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:13.891928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 342/690] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:13.892688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.899724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:13.956142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 349/691] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:40:13 2022] POST /identity/v3/users => generated 254 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:14.129111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:14.151259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caed1c-f2f1-4da0-8f5c-f532a996ca93 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.201805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.202766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.203245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.203714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.204691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:14.205879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.207505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.221843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 343/692] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:14.238231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.443507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d621d8-0862-4e8b-afac-c0f2bdb478ea None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.505001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.510246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.510590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.513799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.522240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.523716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:14.540059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:14.541026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:14.541991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:14.546098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 350/693] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:14.547323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.693156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2afe1-59bd-490c-8cd2-f54327bb389f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.739440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.740434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.740928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.741408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.742366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:14.742900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.744580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd1957-79f9-40e7-a479-4ee8a307dc37 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.763071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 344/694] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:14.768992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:14.848715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:14.871333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18069-dbe0-4097-92d7-32274cd0d02d None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.871975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18069-dbe0-4097-92d7-32274cd0d02d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.872448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18069-dbe0-4097-92d7-32274cd0d02d None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.874083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 345/695] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:14.881783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.882094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.882377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.921812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f408-6e9e-4da8-9f9c-047d2e6e52c5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:14.946766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:14.948037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:14.960718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:14.961461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:14.962356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:14.962948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:14.963445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:14.964342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=d978a00f91b1435f9662492df2d52fd0) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:14.964839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:14.966455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:14.975417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 351/696] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:14 2022] GET /identity/v3/role_assignments?user.id=d978a00f91b1435f9662492df2d52fd0&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:15.044308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 346/697] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:40:15.327243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.438290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393da9b-c778-46b7-8976-46ab50ec5dbf None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.440824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:15.479151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.480585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.481165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.481657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.482508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.484111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-67ac017f-1c37-482e-8ad3-703bfc54f9a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:15.496225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:15.497320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:15.498244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:15.499554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 352/698] 10.222.0.61 () {56 vars in 1129 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:15.506213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.623686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef9a92-d4dd-4dc9-8fa2-16543c082faf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.655321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc8ad-01e0-411a-820b-33ec8b10e739 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.655609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc8ad-01e0-411a-820b-33ec8b10e739 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.655890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc8ad-01e0-411a-820b-33ec8b10e739 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.657230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 353/699] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:15.663962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b561-640b-4cdd-88e8-6de33d7a6076 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.664497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b561-640b-4cdd-88e8-6de33d7a6076 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.664953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.665263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b561-640b-4cdd-88e8-6de33d7a6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.665579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.666007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.666286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.667101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:15.667476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.669111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.674729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 347/700] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:15.680800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.690759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3c36b561-640b-4cdd-88e8-6de33d7a6076 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:15.692860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:15.693978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3c36b561-640b-4cdd-88e8-6de33d7a6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.784467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 354/701] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:40:15.790496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143878e-d02e-4c0c-a872-922c763a9b2e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.791028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143878e-d02e-4c0c-a872-922c763a9b2e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.791028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143878e-d02e-4c0c-a872-922c763a9b2e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.792352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 355/702] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:15.800812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.801105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.801383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.825625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023d2c5-3141-4617-8037-84d4ca343698 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.841595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:15.843041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.885662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.886227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.886512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.886789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.887435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:15.887741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.889113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.896462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 348/703] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:15.990465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 356/704] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:16.075836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.151979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.185201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d3b0-568f-4411-a2ba-f3856c11c820 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.221551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.222220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.222508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.222784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.233582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:16.239667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:16.240615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:16.241519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 349/705] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:16.246911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.274851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.353703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.381333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b48e9-ca57-4fa5-b921-bac040602405 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.445544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.446119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.446402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.446677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.447457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:16.447820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.449295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92587a7c-a139-43d7-9142-4abfab0e3713 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.459250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 357/706] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:16.460688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd940a-504f-4f09-b494-e26b2e6e6eb3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.460973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd940a-504f-4f09-b494-e26b2e6e6eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.461253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd940a-504f-4f09-b494-e26b2e6e6eb3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.466572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 358/707] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:16.467458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd940a-504f-4f09-b494-e26b2e6e6eb3 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.505306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac25b-56af-43b9-b9cd-7b826ee10eab None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.547438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.559394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.560107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.560455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.560794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] PATH_INFO: `/v3/services/network` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.561454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.562943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-627c35ad-258e-4446-a584-70c4ad1eb145 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:16.577459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:16.578688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:16.579726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:16.581314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 350/708] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:16.582733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.583097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.583445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.583621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.601427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd940a-504f-4f09-b494-e26b2e6e6eb3 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.604721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:16.606052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:16.646505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.647419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.647864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.648285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.662610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.664584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.688583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 351/709] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:16.688583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:16.688938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:16.690650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:16.691537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:16.691537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:16.691537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:16.691537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 359/710] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:16.695451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.828329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb85cd-f0db-4b63-8403-7eeaf6f63faf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.836503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171590c-5ac2-4f28-a95b-4e8173b333de None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:16.884532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.885910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.886531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.886817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.887098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.896472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:16.896472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.896472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.899583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:16.900241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:16.900567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:16.900848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:16.901481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] RBAC: Adding query filter params (name=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:16.901996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:16.903361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:16.907492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:16.910068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 352/711] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:16.913828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 360/712] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:16.916509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:16.921744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.036062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d664ed-d175-4a14-9136-e886233b51dd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.040164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046b4f9-d97c-41a4-9dc8-c28ef092a3ad None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.072476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.073134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.073415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.073690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.077500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.079345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.079833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.080264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.081055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] RBAC: Adding query filter params (type=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:17.081514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.082860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.083275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.084289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.093482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 353/713] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:17.093482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:17.107320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:17.108313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:17.109238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:17.113794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 361/714] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:17.117360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.162777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.222536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a64ddb-1dfd-4e2d-9e1d-964b9dc7ec7d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.262174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.301932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.302576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.302858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.303134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.317211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:17.322666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:17.323570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:17.324382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:17.325005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e41f8-65cc-4c83-b89c-7a8a8d333aa9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.325080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 354/715] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:17.331841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.379152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.380151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.380635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.381138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.382117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:17.382648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.384292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.409396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 362/716] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:17.414772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.539908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b9e2-f679-4f88-acc3-5d11b96442e7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.565665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fa9d2-3d9d-4dd0-9745-4d4e8b33d0a6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.569385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.590379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.611694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.612422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.612708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.612985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.624057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.624682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.624965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.625239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.625938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:17.626247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.628180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.653918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 355/717] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:17.654843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.739138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.740596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf60fe-6db4-4bde-88ae-39dae8b6072c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.821392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59838825-5233-4de4-a71b-bb8bc1c890c8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:17.859826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:17.860595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.861373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.861724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.866003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 363/718] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:40:17.867578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3252a-efe9-433c-b43f-5c04869cb8a4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.867871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3252a-efe9-433c-b43f-5c04869cb8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.868149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3252a-efe9-433c-b43f-5c04869cb8a4 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.873856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 364/719] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:17.874747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3252a-efe9-433c-b43f-5c04869cb8a4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:17.877479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:17.879282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0c250d59-e2b5-49c2-855c-acb82bba9015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:17.898733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:17.899723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:17.900788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:17.900788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:17.900788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:17.900788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 356/720] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:17.901625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.901625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.902408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:17.906582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.927645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:17.928889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.952376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.011372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 357/721] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:18.012547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.014907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3252a-efe9-433c-b43f-5c04869cb8a4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.054102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.054770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.055111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.055328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.067449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.068949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:18.089550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:18.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:18.091867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:18.091867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:18.091867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:18.094087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 365/722] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:18.099566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.140702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502273ac-eae7-4d83-a4db-caefae2fec87 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.178708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.179699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.180204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.180714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.181573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:18.182097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.183735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.196113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 358/723] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:18.201839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.223409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.260007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.317391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe5409-086d-42f8-ad90-74c48bc09728 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.368258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.368904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.369144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.369414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.370105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:18.370407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.377379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.377731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0f67-e6d0-4966-80ae-a5671684920f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.384016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 366/724] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:18.390888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.414595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.416170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.416880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.417573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.427382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.430084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:18.449044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:18.450831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:18.451753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:18.457859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 359/725] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:18.458710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.506455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d436b-3658-4b2e-ad7a-3f751f57d2bf None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.539302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.540259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.550930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.551695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.552038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.552322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.560181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.561740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.568878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259fec3-db11-4a4e-bb10-1205fbd72f1e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-1c3c897b-23f0-4279-a986-f32c51687203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:18.575189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:18.576053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:18.576897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:18.580888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 367/726] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:18.582906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba8a3-299c-49ab-b25c-98d17000767b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.583561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba8a3-299c-49ab-b25c-98d17000767b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.583848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba8a3-299c-49ab-b25c-98d17000767b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.585226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 368/727] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:18.585889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba8a3-299c-49ab-b25c-98d17000767b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.604972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.605607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.605940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.606218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.618538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:18.625405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:18.627076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:18.627924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 360/728] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:18.629141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.703426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba8a3-299c-49ab-b25c-98d17000767b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.736470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8245-79b3-4936-bbcd-7e1f80c2b880 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.740019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.740632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.740922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.741205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.741966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:18.742282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.743898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5610-5b94-4d7d-b91e-84a32de91dd6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.766458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 369/729] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:18.766458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.766458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.766458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.779488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.780105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.780442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.780720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.781475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:18.781818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.782110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:18.783330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:18.783428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.787348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.805156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 361/730] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:18.805156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.830215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.855416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 370/731] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:18.856497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.940409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827c19-d047-480a-9833-9d21d28cbb9b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.970989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39305-94fb-41af-b15f-1b10756a2710 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.977917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.978533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.978814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.979091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.979763 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:18.980071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.981497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.991304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 362/732] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:18.992178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.018050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.019149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.019830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.020297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.057221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.082608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.107391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6dda3-1890-4ee3-bbcb-fb659499406a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.111993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.113470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.149211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.149854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.150221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.150518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.151254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:19.151573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.152998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.165306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 363/733] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:19.165306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.247320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 371/734] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:19.248107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.279454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b249b72-5686-4cd9-9ddb-56170125b6b4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.305353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.321599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.322272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.322555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.322829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.334430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.335875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.341806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f6957144-a996-443c-829e-002a41a8fa3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:19.350885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:19.351901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:19.353488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:19.353488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:19.353488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:19.353488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 364/735] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:19.353488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0910b9-f0f8-4510-b81e-79cd60e9f295 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.353779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0910b9-f0f8-4510-b81e-79cd60e9f295 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.354068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0910b9-f0f8-4510-b81e-79cd60e9f295 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.359433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 365/736] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:19.359433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0910b9-f0f8-4510-b81e-79cd60e9f295 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.375297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955913d-96a1-4d8c-bb8e-feaf56786fc6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.413596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.414368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.414955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.415246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.416162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.417989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.437859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 372/737] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:19.438731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.473826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0910b9-f0f8-4510-b81e-79cd60e9f295 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.515145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.516071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.516535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.517629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.529866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.531625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a7e35498-e8de-4417-9bb0-c8f74db6fa54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:19.550467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:19.551481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 366/738] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.552378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.582214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:19.583871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:19.602218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d5f45-8033-4172-b403-4091d7409820 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.605302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.649334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.649986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.650276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.650556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.651208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:19.651518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.652894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.661702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.667619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 373/739] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:19.668482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.681694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 367/740] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:19.682948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.816978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3702-ff78-483d-aafa-50dc33f1c5cd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.853543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.854191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.854475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.854751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.855392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:19.855756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:19.857352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:19.869419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 374/741] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:19.874772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:19.879903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a73b4-14cc-4f7e-8269-08c774c5a1da None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.941189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:19.982481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:19.983156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:19.983421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:19.983697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:19.991691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21361e-045a-4b81-8976-fbeb9ff842b0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:19.998850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.000316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:20.028466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:20.029469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 368/742] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:20.030429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.045746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.046412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.046696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.046967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.055846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.057570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.059385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:20.076257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:20.077166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:20.078098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 375/743] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:20.078608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.168089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecff6d-a0a3-459f-a82e-79f5867d4283 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.202576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb8f8-5ba3-4b82-85d6-adb7b6b469ff None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.212968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.213587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.213899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.214176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.214825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.216553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.228642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.237597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 369/744] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:20 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:20.238759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.284766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.285430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.285718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.286072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.287301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:20.287301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.288870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.322346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.324895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 376/745] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:20.330793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.356634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f4da4-4649-4ca7-9bd5-14f0d775ea62 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.404187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.405259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.405789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.406270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.407190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:20.407868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.409564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.424464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 370/746] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:20.430694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.500125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd243-2788-43f3-82b2-99a2567f0d9a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.537131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.537747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.538061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.538338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.560750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629bb25-a640-4bc6-b31e-c66ad98a2287 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.592363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.606610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.615630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.617012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.617806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.618283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.619396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=e7fb2436712f48e792e4ee5a6d33bdf1) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:20.620450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.622395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.626893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.628348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.631876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 371/747] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/role_assignments?user.id=e7fb2436712f48e792e4ee5a6d33bdf1&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:20.747303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 377/748] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:40:20.753091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.899004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd617ec-dd37-4082-8210-f26fa7478bbc None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:20.935648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:20.936296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.936583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.936859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.947846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:20.949294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:20.963543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:20.964475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:20.965346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:20.965346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:20.965346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:20.965346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 372/749] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:20.970853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.073375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:21.111070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33695e54-8a8b-440e-96f7-71b38cb0a4b4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.159697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.160237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.160525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.160798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.161462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:21.161783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.163166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cec033-191d-490b-a829-cb05b1ab0956 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.180913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 378/750] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:21.186422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.283322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:21.327341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db7c9-8477-4c54-94fc-177cd0a60367 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.327672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db7c9-8477-4c54-94fc-177cd0a60367 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.327912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db7c9-8477-4c54-94fc-177cd0a60367 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.330100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 379/751] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:21.350229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72a41-e4e7-45bc-997f-3620526e61dc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.350539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72a41-e4e7-45bc-997f-3620526e61dc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.350794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72a41-e4e7-45bc-997f-3620526e61dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.352458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d086d-0121-4f44-ae63-997efd5c41da None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.386672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.387308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.387589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.387862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.389525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-efe72a41-e4e7-45bc-997f-3620526e61dc None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:21.390774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-efe72a41-e4e7-45bc-997f-3620526e61dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.395318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.396760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:21.408588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:21.409529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:21.410479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 373/752] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:21.422849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.511805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 380/753] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:21.584132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bacdbe-080b-480a-85c1-e322fb224471 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.596515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:21.628975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ebd4-2709-4623-8227-c3e68cc0bf64 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.629299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ebd4-2709-4623-8227-c3e68cc0bf64 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.629541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061ebd4-2709-4623-8227-c3e68cc0bf64 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.634680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 381/754] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:21.637918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.638772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.638970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.639263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.639545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.639889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.640364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.641273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:21.642367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.644230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.660042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 374/755] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:21.669646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.675313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:21.676502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.794938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:21.804813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627e48-cb30-4ba7-9f91-12041ab7e2bc None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.841145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.842151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.842665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.843078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.843965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=d978a00f91b1435f9662492df2d52fd0) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:21.844417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.846022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.851671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 382/756] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:21.852364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 375/757] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/role_assignments?user.id=d978a00f91b1435f9662492df2d52fd0&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:21.852548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:21.981290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1bd70-33e3-4658-bb2e-91cb71c6cd7f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.030795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.031719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.032236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.032700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.050936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:22.056116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:22.057187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:22.058280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:22.060589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 383/758] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:22.066965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.101325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.124868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.176827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acad0-d7fe-41cb-9e51-399266230c44 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.198554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.219029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.219675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.220484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.220760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.221439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:22.221752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.223158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.241098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 376/759] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:22.250754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.259420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efde3-898b-4f1d-b399-1b679434e945 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.315099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.320126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.320634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.321132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.322007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.323609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:22.336288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:22.337285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:22.338135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:22.339410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 384/760] 10.222.0.61 () {56 vars in 1129 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:22.345793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.444609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.454622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db5b-02bd-443b-bd48-42b0aecc7f61 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.519035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.520236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.522590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.523647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.531168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a90bf-85ea-4be8-a1e8-0f39425e456f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.548373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.550409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.568656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:22.581538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:22.582543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:22.584050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:22.584050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:22.584050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:22.584050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 377/761] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:22.589456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.615524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.616684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.616967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.617246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.617919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:22.618645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.620408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.629054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 385/762] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:22.638992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.766365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd9d1-88a4-4808-9fe6-624039167a75 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.821619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b66d4-34f8-495f-9f7d-08f00a23fd76 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:22.836182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.836812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.837103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.837417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.838155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:22.838467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.839858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.869331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 378/763] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:22.875724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.886877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:22.887498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:22.887779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:22.888050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:22.888708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:22.889011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:22.890410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:22.895211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:22.908069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 386/764] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:22.918950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:22.973849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.002005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815500aa-72af-42a1-86e4-d461af367dcd None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.037673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac652-2ecd-4e5d-9f20-dd282dff432f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.038219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.038842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.039125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.039398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.046630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.048178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-e661279e-e9f8-4e39-af8c-47df4c657bb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:23.059948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:23.061089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 379/765] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf2c43-8e36-4532-8d0c-73401424b35f None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.067699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf2c43-8e36-4532-8d0c-73401424b35f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.068375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf2c43-8e36-4532-8d0c-73401424b35f None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.068375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 380/766] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:23.068375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf2c43-8e36-4532-8d0c-73401424b35f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.084097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.084636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.084925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.085207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.086055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] RBAC: Adding query filter params (interface=public, service_id=54f5fd6f55d64f319e4882c68cd79507, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:23.086288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.087653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2eff-64c2-41f4-9e82-117b1935f99f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.096085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 387/767] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:22 2022] GET /identity/v3/endpoints?service_id=54f5fd6f55d64f319e4882c68cd79507&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:23.099026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74346-7a8f-4798-a5c7-3c220db75593 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.099540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74346-7a8f-4798-a5c7-3c220db75593 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.100476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74346-7a8f-4798-a5c7-3c220db75593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.118602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-98a74346-7a8f-4798-a5c7-3c220db75593 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:23.119775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-98a74346-7a8f-4798-a5c7-3c220db75593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.145282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.183844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf2c43-8e36-4532-8d0c-73401424b35f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.194645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 388/768] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:23.196020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c5e8-cf61-4b54-91b5-4f092c94d454 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.196309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c5e8-cf61-4b54-91b5-4f092c94d454 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.196583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c5e8-cf61-4b54-91b5-4f092c94d454 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.197948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 389/769] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:23.198521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c5e8-cf61-4b54-91b5-4f092c94d454 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.240012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.241431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.242208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.243609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.244574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:23.245087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.246795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589dc53-0544-4274-814d-aa6ce305ec6f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.248853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.273280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 381/770] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:23.275052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.275338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.275612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.292980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:23.294187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.325310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c5e8-cf61-4b54-91b5-4f092c94d454 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.362223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 382/771] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:23.362995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.365043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.366023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.366601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.367096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.367965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.369636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.376012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 390/772] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:23.424355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.468689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.472307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278268-98da-48c8-8db0-7e6a1f02f5d5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.509454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.510167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.510449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.510782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.521426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.522975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:23.543631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:23.544631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:23.545495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:23.545495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:23.545495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:23.545495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 383/773] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:23.552320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.625810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315333b-8136-487c-9d1a-d8c4ae4369b1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.654154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.668658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.669387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.669673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.670042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.682037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:23.686977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:23.687912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 391/774] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:23.690312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.699112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fee12-f9d6-47aa-9c3a-a7a48f7de75c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.708934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.751646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.752730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.753015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.753595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.754279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:23.754584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.756886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.776431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 384/775] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:23.777287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.827487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789b3f2-548d-40c5-8a2b-3c00d55c467c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.876465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.877136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.877420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.877971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] PATH_INFO: `/v3/services/network` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.878983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.880871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.887870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf7dc-2142-4234-893f-eab0908ecba5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:23.892532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:23.893474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:23.894314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 392/776] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:23.895940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.925954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.926760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.927150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.927528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.928348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:23.928795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.930360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.930467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.945352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 385/777] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:23.946672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.979844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.033434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96c3d2-a798-47f8-9626-a6d19b2b9415 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.067830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606144d0-f4a9-47d9-8b02-b570f93d7080 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.079994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.081427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.081889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.082588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.091979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.094568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.105151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.105932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.106372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.106749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.107529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] RBAC: Adding query filter params (name=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:24.107934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.109386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:24.110950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:24.111948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:24.113039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:24.115780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 393/778] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:24.116731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.126092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 386/779] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:24.126092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.210055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.230462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28bd2-74a7-451f-8657-4d22e247db1e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.235268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.245340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12facbe-649f-407f-8338-c7713d489f5b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.271437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.272072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.272600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.272883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.280909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.281524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.281833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.282117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.283431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:24.283746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.285173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.287149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.289239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.301797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 387/780] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:24.301797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-08128cd8-2a1d-4832-83a4-86bc0e339d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:24.305801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:24.306733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:24.307606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:24.307606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:24.307606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:24.309908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 394/781] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:24.311819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ed50-beac-402c-b43a-9aae58ce574d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.312524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ed50-beac-402c-b43a-9aae58ce574d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.312811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ed50-beac-402c-b43a-9aae58ce574d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.314567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 395/782] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:24.315102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ed50-beac-402c-b43a-9aae58ce574d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.409286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdca2ed-e57a-44e0-a7b0-85a2db792f50 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.416743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ed50-beac-402c-b43a-9aae58ce574d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.446756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.447415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.447709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.447991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.448627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] RBAC: Adding query filter params (type=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:24.448940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.449756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.450378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.450474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.450696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.450971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.452900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=640894aa402744af861080d8d0d80f66, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.454957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57fee4-147b-463d-80b2-abc337e3d6cc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.460537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 388/783] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:24.460537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.470672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.485810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 396/784] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:24 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:24.485810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.485810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.485810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.487168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.505416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:24.506702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:24.596105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 397/785] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:24.597436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.600167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9af7-8ac2-4e17-bbd1-3ea894cb523e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.680817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.681471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.681759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.682076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.682808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:24.683152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.685618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.703712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 389/786] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:24.709958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.743194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5b6c9-4fcb-4396-8451-e104e631b689 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.787337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.802908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.803524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.803808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.804076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.804776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] RBAC: Adding query filter params (interface=public, service_id=e64a0eb70fc54871a850e98c38eee683, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:24.805083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.806475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.820337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 398/787] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/endpoints?service_id=e64a0eb70fc54871a850e98c38eee683&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:24.829394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.846832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:24.854945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856a5e-f6ef-4f2d-9a12-4959da34d89a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:24.892007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:24.892650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:24.892939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:24.893217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:24.901494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:24.902989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:24.916974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:24.917992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 390/788] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:24.919544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.003228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4aa72-c3c6-4f0c-9f67-c0fa7fe001d7 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.042852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.044447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.044940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.045427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.046877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.049481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.053119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97694-4ed0-4e16-b504-d11a1f50c891 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.057721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 399/789] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:25.058862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.131096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.132029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.132310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.132585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.140111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.159847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:25.165501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:25.166497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:25.167293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:25.168313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.168708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 391/790] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:25.176052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.268588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35981f-339c-4b9d-b882-fa6a1701e76a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.306286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c837659-404a-463b-be4f-68187c4986e5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.308543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.309226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.309517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.310217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.311089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:25.311399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.312855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.331341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 400/791] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:25.336672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.347657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.348770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.349061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.349734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.350688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:25.351043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.352709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.365112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 392/792] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:25.371097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.447335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.454071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f663ff-8c61-4ec9-9614-ea8878accefd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.487008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.524265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.524825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.525107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.525381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.528075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f460c-d171-4406-90e9-2f456c06095f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.547087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.549339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-73acc55a-78c7-4f1c-a913-d08d0ac494da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:25.570746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:25.571777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:25.572630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:25.572630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:25.572630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:25.572630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 401/793] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:25.573531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75cbe-44c6-4099-84e5-e486f80344f6 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.573863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75cbe-44c6-4099-84e5-e486f80344f6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.574145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d75cbe-44c6-4099-84e5-e486f80344f6 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.577792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 402/794] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:25.577792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d75cbe-44c6-4099-84e5-e486f80344f6 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.595386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.596037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.596366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.596645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.609354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.612009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8d4967db-86ba-4190-a5b2-370a83e5b716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:25.631913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:25.632868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:25.633720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:25.633720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:25.633720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:25.633923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 393/795] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:25.635522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553356-16bf-4467-8438-af75290a1391 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.635725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553356-16bf-4467-8438-af75290a1391 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.636053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553356-16bf-4467-8438-af75290a1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.657462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5c553356-16bf-4467-8438-af75290a1391 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:25.658903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5c553356-16bf-4467-8438-af75290a1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:25.691332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d75cbe-44c6-4099-84e5-e486f80344f6 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.727961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.728629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.728917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.729193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.729912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:25.730189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.731560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.749138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 403/796] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:25.749719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 394/797] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:25.750163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.751074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c553356-16bf-4467-8438-af75290a1391 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.808816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.838130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:25.879015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c553356-16bf-4467-8438-af75290a1391 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:25.920035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:25.921064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:25.921552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:25.922059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:25.929986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:25.932151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:25.945813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:25.946714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:25.947583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:25.949902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 395/798] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:25.958822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:25.996452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0535b-c493-4289-b342-bf29a08f6387 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.043202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.043817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.044095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.044366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.045110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:26.045413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.047668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.071555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 404/799] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:26.076827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.144561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.149184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490707-52ff-44ef-b1b7-c0b2d2e4e150 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.195796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129631a-21fa-4325-9150-02806d97070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.197039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129631a-21fa-4325-9150-02806d97070c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.197858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.198286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129631a-21fa-4325-9150-02806d97070c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.198449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129631a-21fa-4325-9150-02806d97070c None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.199208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129631a-21fa-4325-9150-02806d97070c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:26.199414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129631a-21fa-4325-9150-02806d97070c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.202468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129631a-21fa-4325-9150-02806d97070c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.216825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317a8d-8cab-43b4-a773-f0dea3ddc2d3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.220623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 396/800] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:26.221803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129631a-21fa-4325-9150-02806d97070c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.257147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.257941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.258169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.258449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] PATH_INFO: `/v3/users/swift` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.267762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.268730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:26.280078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:26.281015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:26.281961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:26.286037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 405/801] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:26.286917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.349971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129631a-21fa-4325-9150-02806d97070c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.393847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.395185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.395733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.396230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.397089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.399408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.410972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9bf4-ca8b-407e-933e-024bab72ee7a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:26.411783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:26.412761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:40:26.413580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:26.420575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 397/802] 10.222.0.61 () {56 vars in 1129 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:26.420575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.451440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.459258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.460091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.460381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.460661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/e7fb2436712f48e792e4ee5a6d33bdf1/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.479661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=e7fb2436712f48e792e4ee5a6d33bdf1, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.481671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.485322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.505469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 406/803] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:26 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/e7fb2436712f48e792e4ee5a6d33bdf1/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:26.506630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.552233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6c5c-ffc4-4777-adba-c8a5083772e7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.629242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.630415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.631735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.632165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.634458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:26.634983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.638509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.684546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 398/804] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:26.688845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.699982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4c97d-df48-4309-a0a7-c331d379feb5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.749170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.749806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.750099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.750374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.751550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:26.751863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.753307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232a43-1897-419f-a333-4d3c338cc299 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.758961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 407/805] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:26.760189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0968f4-1689-4bf6-836d-9e8446c13f19 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.760528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0968f4-1689-4bf6-836d-9e8446c13f19 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.760747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0968f4-1689-4bf6-836d-9e8446c13f19 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.766471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 408/806] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:26.768387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0968f4-1689-4bf6-836d-9e8446c13f19 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:26.791638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.812254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc525c7-6ff9-444b-934a-65aaa473f8b5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.846002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:26.853457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.854438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.854927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.855401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.866214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.867947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.893684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0968f4-1689-4bf6-836d-9e8446c13f19 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:26.936665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:26.937340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.937629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.937950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.939139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:26.939442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:26.940854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207abe-ca01-4d92-9c5b-550e35719380 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:26.947189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 409/807] 10.222.0.61 () {56 vars in 1124 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:26.948667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:26.948958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:26.949234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:26.970754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:26.972032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:27.005655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:27.006649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:27.007513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:27.007513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:27.007513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:27.009590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 399/808] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:27.010686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.124692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5588f-a138-4acd-bae4-1b9de9b481c8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.162091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.162946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.163372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.163786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.164613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.166178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1101-f95d-4b5d-9459-f1af839a5694 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.170067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 410/809] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:27.170987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.179430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.217668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 400/810] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:27.235722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.288472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056df9bd-14ae-4907-b199-1e3b89685269 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.312469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c648fc-bc73-4891-96dc-c3d1cad5ea40 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.313137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c648fc-bc73-4891-96dc-c3d1cad5ea40 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.314274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c648fc-bc73-4891-96dc-c3d1cad5ea40 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.320215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 401/811] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:27.322304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.322935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.323482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.339107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.340100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.342045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.342706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.346636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:27.347254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.349960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:27.350705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.354779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:27.377717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 411/812] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:27.383435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.459581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 402/813] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:27.460954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.507649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301524bc-3bda-4134-b0eb-ba7bb7fa0dd3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.520442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.548303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.548951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.549234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.549541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.557155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.558658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:27.571654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:27.572545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:27.573883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:27.574306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12db259-23e0-4bb9-87e8-e43ad4992bce None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.574384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 412/814] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:27.580760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.596060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.612039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.612778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.613065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.613339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.624191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:27.629617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:27.630564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:27.631401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 403/815] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:27.636762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.694198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5109-d0cd-4bd8-b8d2-7c45284e6ca6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.730748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.731724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.732224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.732749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.733647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:27.734193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.735878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.742850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85d99-1b57-42e8-a163-dd4778b29ed1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.749587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 413/816] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:27.758739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.780819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.781441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.781733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.782088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.782886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:27.783201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.784580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.793446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 404/817] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:27.799559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.827380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.844666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:27.905755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e8d6-2005-4e8c-950e-57ce16104f01 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.919523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae46c4-70ab-4c71-a232-6aac3f50edeb None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:27.941496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.942177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.942458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.942733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.953301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.954768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.965804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:27.966640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:27.967024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:27.967404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/d978a00f91b1435f9662492df2d52fd0/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:27.969433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=d978a00f91b1435f9662492df2d52fd0, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:27.969565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:27.970458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:27.971312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:27.971312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:27.971312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:27.971486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:27.975702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 405/818] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:27.976565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:27.989587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 414/819] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:27 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/d978a00f91b1435f9662492df2d52fd0/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:40:27.991342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.111316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da79aa-a3d2-4293-97e6-06541f3092b9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.138898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.156732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.158287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.158777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.159822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] PATH_INFO: `/v3/services/network` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.160629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.162718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:28.175399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:28.176522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:40:28.177334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:28.181874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 406/820] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:28.184966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.187472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.197711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e140138-b467-4cc7-8178-0e1834f0316a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.237432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.238123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.238370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.238613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.239274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:28.239576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.240987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.253827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 415/821] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:28.259296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.302141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4d2d-2390-4863-833c-f0f57efb1603 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.338975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.339968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.340515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.341016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.341904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:28.342413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.344056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.350205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 407/822] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:28.357900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.384809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.410877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294554-16a0-43d3-9822-5e779763c612 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.481317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.482737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.483168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.483623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.493574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.495519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:28.508306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:28.509343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:28.510520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:28.512672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 416/823] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:28.519633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.541869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9718452-fe49-4013-a1fb-57c3ba71c1f4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.545283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.591744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.593094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.595332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.596483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.597973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] RBAC: Adding query filter params (type=network) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:28.598770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.603883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.617865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 408/824] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:28.623369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.751452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c8b7d-5507-4515-846b-d8ebd03ec0cc None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.757234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:28.779733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559c03-2e9b-4dfe-87cb-e42141d106df None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:28.819028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.820034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:28.820899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.821874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.822387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.823052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.823395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.823869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.824765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.825730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:28.827352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d0eb-7cb2-49d3-a4aa-8a7b3890fca3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.827886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:28.830120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41349c-2f1b-4398-95f5-1afa7246ada3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:28.855991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 417/825] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:28.858369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71428c-705e-4d4c-a60a-46de27023e59 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.858866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71428c-705e-4d4c-a60a-46de27023e59 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.859344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71428c-705e-4d4c-a60a-46de27023e59 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.861310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 418/827] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:28.862039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 409/827] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:28.862629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71428c-705e-4d4c-a60a-46de27023e59 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:28.878698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:28.879038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:28.879291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:28.920626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:28.924403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:28.971529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.004063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71428c-705e-4d4c-a60a-46de27023e59 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.041027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.041645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.041959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.042236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.068657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 410/828] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 24 05:40:29.115903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.117370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.180973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.222492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 419/829] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:29.228192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.308987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.349929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fa5eb-1973-4684-a0cc-6861b2b2df85 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.392795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.393525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.393921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.394266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.404638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.406189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.410207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:29.432509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:29.433474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:29.434388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:29.434388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:29.434388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:29.436717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 411/830] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:29.442786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.522828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1476c0-f68f-4d76-bee3-a407d5e9d02a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.570483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.571338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.571780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.572553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.580290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665d1e-d0e5-4ff7-bf19-7c476086513a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.587059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:29.593722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:29.594854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:40:29.595846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:29.598982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 420/831] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:29.604711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.619127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.635850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.636408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.637893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.638379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.638833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.639785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:29.641190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.643499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.660289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 412/832] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:29.666515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.725854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a603-858f-471e-afaf-4d2aabe8ba76 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.764286 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.765095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.765383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.765656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.766395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:29.766698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.768053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299843f-84dd-4640-9f85-428538e815d6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.769987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb073c3-9d9e-4253-9b03-00827da554d5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.776284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 421/833] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:29.777703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023e0-1910-41bf-847a-b9d3be3b2a8a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.778039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023e0-1910-41bf-847a-b9d3be3b2a8a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.778315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023e0-1910-41bf-847a-b9d3be3b2a8a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.779650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 422/834] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:29.785259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a023e0-1910-41bf-847a-b9d3be3b2a8a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.812980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.813635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.813956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.814226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.821499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.822941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f9e72d6a-c7a9-445b-8337-20161431c326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:29.834114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:29.834969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:29.835833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 413/835] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:29.836884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.836884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.837049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.856794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:29.858010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:29.883707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.900808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a023e0-1910-41bf-847a-b9d3be3b2a8a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:29.902473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:29.937809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 414/836] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:29.937809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:29.948138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:29.949284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:29.949783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:29.950323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:29.965142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:29.967333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:29.991479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:29.992657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:29.993663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:29.993663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:29.993663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:29.997784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 423/837] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:29.999656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.049475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2291-2773-40d7-9da3-205a394b4ffe None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.085891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.086457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.086745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.087034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.087790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:30.088073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.089491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.107066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 415/838] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:30.108378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.143686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.146185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cb7db-8ed8-4f0c-9414-15f115bf2162 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.184438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.185103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.185396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.185680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.186368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:30.186733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.188135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334f8e-795c-4d23-8fc2-5684f333693c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.195588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.202102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 424/839] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:30.203531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf120b-7345-4312-8649-8c7801848750 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.204561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf120b-7345-4312-8649-8c7801848750 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.204840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf120b-7345-4312-8649-8c7801848750 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.211156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 425/840] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:30.211156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf120b-7345-4312-8649-8c7801848750 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.215741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096d9f4-c115-47e6-98ba-ea67dbd87e0c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.251086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.251694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.251977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.252255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.252985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:30.253297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.254743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947c4d1-eb1b-457d-84fa-442b7be67b45 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.260997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 416/841] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:30.262246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.262532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.262813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.282641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:30.283896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:30.323458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf120b-7345-4312-8649-8c7801848750 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.362826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 417/842] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:30.363397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.373896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.374704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.374994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.375273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.388331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.390415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.394944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:30.409815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:30.411395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:30.412505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:30.414606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 426/843] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:30.420776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.482444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081796-aaa7-416e-8a94-926818fb4765 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.489239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.521652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.524072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.524354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.524626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.525209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.526601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:30.535792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:30.537144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:30.538012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 418/844] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:30.542764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.553486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247f2f9-583e-4857-a460-d8d4b07478f9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.600181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.601167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.601667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.602795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.603812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:30.604797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.607292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.634105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 427/845] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:30.635918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.669006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.680123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ab30-d74c-4882-ae8c-75e49fdc0531 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.719787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.720400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.720683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.720959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.721588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:30.721926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.723401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.733043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 419/846] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:30.733043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.745497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbe3b-4c8e-4129-bb04-d308a46a157c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.762409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.781396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.782071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.782358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.782635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.841995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f867b3-5881-4289-9622-16ee18fbb822 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:30.853649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:30.855333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:30.882750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:30.883628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:30.883979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:30.884235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:30.894654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:30.899820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:30.900711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:30.901525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 420/847] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:30.902823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.929855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:30.968423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 428/848] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:40:30.968423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:30.986190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.020690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d15d-92b5-4195-8726-e0a75d20356c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.062761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.063671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.063957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.064436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.065388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.065837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.067164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.071505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 421/849] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:31.072278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.081398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d5ca-4e1b-45d1-b183-339bbe36f84c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.122909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.123871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.124369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.124820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.125796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.126319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.128005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.137968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 429/850] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:31.144371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.167367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.192161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fb48a-accc-4a10-af27-16cd2b46087f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.234157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.234796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.235112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.235389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.246569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.247690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.258798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:31.263496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:31.264477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:31.265404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:31.265404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:31.265404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:31.270172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 422/851] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:31.271074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.288158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee0cf-4e90-486d-9569-8cd5c954b5cc None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.326455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.327085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.327379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.327942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.339665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.341123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:31.356701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:31.357686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:31.358764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:31.358764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:31.358764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:31.358764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 430/852] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:31.363863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.404366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649667e-b31b-4412-9504-8096dbe87908 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.437453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.445008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.445840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.446137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.446483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.447526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.447851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.449651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.466598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 423/853] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:31.471653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.500245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9f565-25f1-4a1a-8f16-d8e3e8e438cd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.530780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.538440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.538963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.539251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.539532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.540180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.540485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.541896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.556840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 431/854] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:31.564038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.589515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a7f5-027f-4200-9cb7-af5781fd3789 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.636134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.637162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.638384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.638746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.647424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.648893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:31.665447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:31.666805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:31.667974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:31.675934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 424/855] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:31.676952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.679755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f9de-4058-48cb-b09e-61ee2809d4c3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.717431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.718093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.718384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.718661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] PATH_INFO: `/v3/users/swift` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.727400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.728589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:31.741090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:31.742073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:40:31.742990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:31.747328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 432/856] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:31.748203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.753378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.805544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:31.828204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ed7df-a472-4df9-9c50-eaaa7808f1c5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.861801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79163-776e-4053-9446-9b2f0054a94a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:31.876292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.877631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.878293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.878842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.879691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.880404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.882471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.898945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:31.904019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:31.904778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 425/857] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:31.907676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:31.928741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 433/858] 10.222.0.61 () {56 vars in 1135 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:31.929799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.021817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6d34-7c2c-464d-a1fa-bb940a76e96e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.035986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.062383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837a083-8e8c-4b49-9a62-487b37bddb74 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.073081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.073878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.076486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.077131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.077946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.080498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=e7fb2436712f48e792e4ee5a6d33bdf1) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:32.081883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.084933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfbf2a-1ab0-4e7c-af76-0ac18d50f5fd None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.100381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 426/859] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/role_assignments?user.id=e7fb2436712f48e792e4ee5a6d33bdf1&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:32.105585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.106240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.106522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.106795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.186658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.188650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.293287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393164b6-fa29-422a-a4e4-016082d1a88a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.293605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393164b6-fa29-422a-a4e4-016082d1a88a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.293916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393164b6-fa29-422a-a4e4-016082d1a88a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.296457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 427/860] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:32.300647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21527-9775-4a27-a952-5f719493d89c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.300831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 434/861] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:32.300929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21527-9775-4a27-a952-5f719493d89c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.301186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21527-9775-4a27-a952-5f719493d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.305745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.316768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.325327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-17f21527-9775-4a27-a952-5f719493d89c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:32.327042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-17f21527-9775-4a27-a952-5f719493d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:32.426060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 428/862] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:32.426702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1324-abf5-4604-b8cd-6ca94323ab1a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.465465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.466057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.466338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.466609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.481832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.483502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:32.498613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:32.499765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:32.501303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:32.501303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:32.501303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:32.503018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 435/863] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:32.510488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21527-9775-4a27-a952-5f719493d89c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.626503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21527-9775-4a27-a952-5f719493d89c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.634497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.664194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.665156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.665587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.666118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.667012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:32.667633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.669196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.682578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 429/864] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:32.690940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.706496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.763259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.808227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0dc1-5352-4497-b5ff-7ecf0e9de0dd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.842878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e57-ad7e-4f53-b3a5-2fccdf9294eb None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:32.844795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.845860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.846259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.847514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.857271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.859047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:32.871974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:32.873030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:32.873909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:32.876284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 436/865] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:32.882730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.889245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:32.889936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:32.890226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:32.890506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:32.891124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:32.892567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:32.904197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:32.905128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:32.906055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 430/866] 10.222.0.61 () {56 vars in 1132 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:32.911686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:32.946544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:32.995496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2681db9-9fe6-433a-bd09-ce7b72ee69cd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.015546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:33.031331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5a83-c2c0-4277-a347-290443de801c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.032442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.033070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.033409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.033690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.034425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:33.034735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.036878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.053483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 437/867] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:33.055542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.078488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.079632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.079914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.080187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.080815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:33.081121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.082514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc680-317b-418f-8089-1b2c29a1a1a2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.087050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 431/868] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:33.088183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4661-a63f-4fb0-825a-03cbf7296aeb None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.088472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4661-a63f-4fb0-825a-03cbf7296aeb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.088749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b4661-a63f-4fb0-825a-03cbf7296aeb None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.089973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 432/869] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:33.092532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4661-a63f-4fb0-825a-03cbf7296aeb None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.173233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae392577-ef01-4533-8c58-0210c3f65ece None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.195475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:33.204060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b4661-a63f-4fb0-825a-03cbf7296aeb None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.211788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.212637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.213178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.213629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.214454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=d978a00f91b1435f9662492df2d52fd0) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:33.214806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.216243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5239d70-1b8e-4745-a3be-3489579a9483 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.224046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 438/870] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:33 2022] GET /identity/v3/role_assignments?user.id=d978a00f91b1435f9662492df2d52fd0&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:33.226311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b14d-0238-4594-97fe-90024f7ef38b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.226741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b14d-0238-4594-97fe-90024f7ef38b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.227177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b14d-0238-4594-97fe-90024f7ef38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.245903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603395d-054d-4073-8436-003dec915a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.246663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603395d-054d-4073-8436-003dec915a84 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.247020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603395d-054d-4073-8436-003dec915a84 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.247369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603395d-054d-4073-8436-003dec915a84 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.248099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603395d-054d-4073-8436-003dec915a84 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:33.248481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603395d-054d-4073-8436-003dec915a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.250001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603395d-054d-4073-8436-003dec915a84 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.253839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-eb66b14d-0238-4594-97fe-90024f7ef38b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:33.255391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-eb66b14d-0238-4594-97fe-90024f7ef38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:33.262230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 433/871] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:33.309681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:33.342945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 439/872] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:33.615337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603395d-054d-4073-8436-003dec915a84 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:33.721483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603395d-054d-4073-8436-003dec915a84 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:33.757318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:33.757954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:33.758237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:33.758508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:33.759162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:33.760523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ae81-5fec-4e76-9f8b-f637dc32717d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:33.777345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 434/873] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:33 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:34.226279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c93-1297-46b9-ac11-ec10cbfc8111 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.226796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c93-1297-46b9-ac11-ec10cbfc8111 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.226872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c93-1297-46b9-ac11-ec10cbfc8111 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.228474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 440/874] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:34.233902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.234197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.234481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.253464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:34.255016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:34.269601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:34.334395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 435/875] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:34.610214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48c93-1297-46b9-ac11-ec10cbfc8111 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.726324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48c93-1297-46b9-ac11-ec10cbfc8111 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.762622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.763726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.764230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.764702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.775672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:34.780613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:34.781500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:34.782401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:34.785023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 441/876] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:34.790756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.894398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564394f1-d5af-4d9c-b5c7-fa5c4b246250 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:34.936612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:34.937228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:34.937510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:34.937795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:34.938490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:34.938791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:34.940166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:34.948977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 436/877] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:34.954460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:34.990298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.059678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c6f4-7127-4784-98a8-a8fcd23b2396 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.098485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.099696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.100185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.100687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.111908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.113617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-d891a06b-fc4e-48db-bd94-facf973826b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:35.129595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:35.130582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:35.131433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:35.131433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:35.131433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:35.133512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 442/878] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:35.139271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.148703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.246544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6a99-f3e8-46b2-96f2-3affb6bdbb1a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.267914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47577-41b2-4e92-ad52-170392754109 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.268452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47577-41b2-4e92-ad52-170392754109 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.268452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47577-41b2-4e92-ad52-170392754109 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.269950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 443/879] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:35.275300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4f6a-6b89-40f5-9bbf-475ad4fa227e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.275592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4f6a-6b89-40f5-9bbf-475ad4fa227e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.275875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e4f6a-6b89-40f5-9bbf-475ad4fa227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.285638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.286579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.287068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.287546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.288426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:35.288935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.290639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c083e1-9b16-4f8f-a1f3-8685509ba8b5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.299701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a99e4f6a-6b89-40f5-9bbf-475ad4fa227e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:35.301966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a99e4f6a-6b89-40f5-9bbf-475ad4fa227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:35.303451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 437/880] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:35.304698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64540-d434-42f2-b251-d967a42069aa None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.304991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64540-d434-42f2-b251-d967a42069aa None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.305271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64540-d434-42f2-b251-d967a42069aa None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.306848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 438/881] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:35.309107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab64540-d434-42f2-b251-d967a42069aa None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.377004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.388589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 444/882] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:35.390794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.392067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.392532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.414473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:35.415733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:35.421272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab64540-d434-42f2-b251-d967a42069aa None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.427498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.473784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.475309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.475603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.475888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.486207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.488108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.493462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 445/883] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:35.505646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:35.506564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:35.507468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 439/884] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:35.514793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.619889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab76c-2236-40d8-9f39-f70e2ea4e0b0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.655686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.656400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.657280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.657564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.658331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:35.658643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.660071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.668333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.685309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 446/885] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:35.689562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.694802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.801643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feec803-2d55-492e-b9eb-a4e2085e31b5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.811615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a890-b9bd-44cd-a770-21349e7205df None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.826948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.836092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.836725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.837013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.837289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.837916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.839276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.845023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.845651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.845964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.846240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:35.847869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:35.848842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:35.849985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 440/886] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:35.850776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:35.917467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.919003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a021c27-c4e3-4fd1-9f9b-c10a3a717638 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:35.921481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.948784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c6383-4a71-4c64-a000-0fd586cf4b88 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:35.982599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:35.983202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:35.983484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:35.983754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:35.984391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:35.985794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5ed00-c045-47b2-860e-2c7ac287c403 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.001286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 441/887] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:35 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:36.002463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88593-b68f-4154-89e4-844852ea091d None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.002751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88593-b68f-4154-89e4-844852ea091d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.003030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88593-b68f-4154-89e4-844852ea091d None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.004432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 442/888] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:36.004947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88593-b68f-4154-89e4-844852ea091d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.027170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 447/889] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:35 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:36.028348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.028636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.028906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.048867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:36.050289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:36.066543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.129775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88593-b68f-4154-89e4-844852ea091d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.132766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 448/890] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:36.133624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.177751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.177975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.178588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.178874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.179156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.179823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.180101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.181559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.190556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 443/891] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:36.194927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.272145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb624e-62e2-4daa-b8c2-0902640a97de None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.307614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234ca8-955d-4977-9800-3fc0789f28b9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.319814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.320642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.321821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.322254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.322773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.338034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.339501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.352239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.353156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.353669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.354258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.355106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.355611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.357184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:36.357304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:36.358175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:36.359045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:36.359045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:36.359045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:36.359045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 449/892] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:36.364502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.365157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 444/893] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:36.408438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.477914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.505078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ee3d-70c5-4a06-b59e-670f33e1ace5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.522935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8d53-8657-4d77-b6d3-f4083ccd633d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.542224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.542841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.543121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.543395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.544046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.544349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.545721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.561869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 450/894] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:36.565432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.577199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.578137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.578686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.579105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.579929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.581435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:36.591703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:36.592859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:36.593735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:36.596663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 445/895] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:36.602984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.653471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.691772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8653-43b8-49a1-b9c7-4ed0fb3e82a8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.722753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dacc89-b0dd-420a-814a-ddf7b5f80173 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.740033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.741175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.741861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.742353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.751200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.753642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.760787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.761400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.761680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.761977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.762602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.762905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.764239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:36.768621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:36.769448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:36.770343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:36.772596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 451/896] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:36.773899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 446/897] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:36.778976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.780010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.784329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.887634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8bb37-8b5d-493a-856e-f778dce5e8ee None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.889303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:36.926076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc7379-642b-4ef5-9e13-68de6336271d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:36.927539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.928261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.928641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.929034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.930252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.930252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.931845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.948910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 447/898] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:36.950027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:36.975605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:36.976682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:36.977529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:36.977982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:36.979025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:36.979473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:36.981886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:36.994056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 452/899] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:36.996272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:37.065713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:37.081670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9253-6b9b-4152-b6b8-ec06cd92ba44 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:37.106873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a86e-9101-491f-9198-5ebfa34690a3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:37.119387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:37.120200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:37.120310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:37.120533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:37.121254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] RBAC: Adding query filter params (role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=e7fb2436712f48e792e4ee5a6d33bdf1) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:37.121563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:37.123093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:37.137797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 448/900] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/role_assignments?user.id=e7fb2436712f48e792e4ee5a6d33bdf1&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:37.160502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:37.161183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:37.161467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:37.161809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:37.162616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] RBAC: Adding query filter params (interface=public, service_id=756c19ab31da44fda296cc4ee21b1158, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:37.162933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:37.164447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bd0c-6d1a-4256-92db-321580ee176b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:37.171523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 453/901] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:36 2022] GET /identity/v3/endpoints?service_id=756c19ab31da44fda296cc4ee21b1158&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:37.177176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:37.209351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:37.294814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051bdd-56b5-4dba-afe3-21f921c6727d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:37.332208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:37.333160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:37.333667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:37.334167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:37.334965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:37.336627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f8e4-f42b-4c84-8321-324bef1ccedb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:37.342999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 449/902] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:37 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:40:38.013076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d188a0-396c-40ee-b251-de924aa48548 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.013570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d188a0-396c-40ee-b251-de924aa48548 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.013646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d188a0-396c-40ee-b251-de924aa48548 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.015379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 454/903] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:38.021408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850c8c1-7eac-4808-8fa1-9b772722c5f9 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.021882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850c8c1-7eac-4808-8fa1-9b772722c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.022237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850c8c1-7eac-4808-8fa1-9b772722c5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.044189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0850c8c1-7eac-4808-8fa1-9b772722c5f9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:38.045923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0850c8c1-7eac-4808-8fa1-9b772722c5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:38.118422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 450/904] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:38.309931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc285a-c01c-44e1-91ce-284cdde91675 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.310139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc285a-c01c-44e1-91ce-284cdde91675 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.310682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc285a-c01c-44e1-91ce-284cdde91675 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.313293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 455/905] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:38.319438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.319749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.320028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.338175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:38.339349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:38.354605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:38.395420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc285a-c01c-44e1-91ce-284cdde91675 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.413552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 451/906] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:38.510808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc285a-c01c-44e1-91ce-284cdde91675 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.540439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:38.547730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.548660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.549167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.549653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.550475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.552299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:38.561928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:38.563609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:38.564674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:38.569128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 456/907] 10.222.0.61 () {56 vars in 1132 bytes} [Wed Aug 24 05:40:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:38.575572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.677656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed84d-bb92-47fd-bbfb-a9d6468c609b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.700379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.713496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.714150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.714433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.714707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.715351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:38.715657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.717100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.722804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 452/908] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:38.728583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:38.745157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:38.832117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd686d-feb4-47eb-a155-1db243cac8cf None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.849803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c19303-b9a5-423a-9461-8549129934f8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:38.877126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.878095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.878388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.878663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.879611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.881684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.891337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:38.891957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:38.892243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:38.892516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:38.893154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:38.893468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:38.894887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:38.900494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 453/909] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:38.902323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 457/910] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:38 2022] POST /identity/v3/services => generated 241 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:38.906126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.005567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:39.032713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db106-c9ed-4bd9-a534-d6fdc33e33b1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.078985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.079596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.079878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.080153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.080848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] RBAC: Adding query filter params (interface=public, service_id=b577250b10254d0c8be7661fe522636c, region_id=RegionOne) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:39.081157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:39.082592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94af94-5e57-48ac-94cc-c8bd8affd149 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:39.090373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 454/911] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:38 2022] GET /identity/v3/endpoints?service_id=b577250b10254d0c8be7661fe522636c&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:39.096466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.158696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:39.171901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16002a-7431-4e84-8a80-dc54ee9c2a87 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.172237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16002a-7431-4e84-8a80-dc54ee9c2a87 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.172507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16002a-7431-4e84-8a80-dc54ee9c2a87 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.173852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 455/912] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:39.178818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.179109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.179387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.197747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:39.198969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:39.214601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661bfc-7946-43b4-a0ca-faed6b6e7f7c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.256992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.258255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.258538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.258810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.259423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:39.260789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8391a38-af4c-4205-8849-b43503a32dce None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:39.269755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 458/913] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:39.279384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feff63-04a9-4a2c-83df-ed87e3a15144 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.279702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feff63-04a9-4a2c-83df-ed87e3a15144 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.279951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feff63-04a9-4a2c-83df-ed87e3a15144 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.283885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 459/914] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:39.286544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 456/915] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:39.288156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.288388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.288668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.308278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:39.309507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:39.390063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 460/916] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:39.566602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.642739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:39.653010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.679461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edae89-3073-4680-9efb-d646df77d472 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.712781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:39.715717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.716611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.717089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.717574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.729880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:39.735186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:39.736078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:39.736876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:39.739499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 457/917] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:39.747536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.772998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b815ce-b4ed-4f35-ba2c-dc9fc45f339e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.820416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.821574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.822025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.822595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.824099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:39.825616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:39.837966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:39.839128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:40:39.840134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:39.842753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 461/918] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:39.848254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.858926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2479-5d3a-408f-b56d-d92a34ed5544 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.887693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:39.899184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:39.900081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:39.900590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:39.901145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:39.902093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:39.902605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:39.904168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:39.913162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 458/919] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:39.918371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:39.979097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88797b-981f-4612-853e-a0f2cbbde26c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:39.996925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.024897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.026233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.027003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.027474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.028474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:40.028972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.031264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.040600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 462/920] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:40.048009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.061846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc8a4e-8b50-4a37-8e37-3b874837e81e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.097355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.098034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.098317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.098589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.112464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.114236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:40.130211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:40.131188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:40.132130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:40.132130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:40.132130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:40.136037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 459/921] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:40.136880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.159284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008ace1-dfe1-4fe8-96ee-f579fdcc9e9d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.182930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.195207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.195829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.196112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.196389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.197031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:40.197334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.198725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.204120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 463/922] 10.222.0.61 () {56 vars in 1114 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:40.210529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.255290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c1ed-3d27-483e-95af-3cacbb4d6ceb None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.266828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.300845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.301700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.302041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.302864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.303521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:40.304102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.305740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.322463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 460/923] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:40.327225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.345265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803279-7e89-4d08-a9a5-d581d89902f1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.383812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.384904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.385400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.385908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.386897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.388536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.417808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 464/924] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:40.457788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e059cb-37a9-4821-9996-d168cd07947a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.459931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.508783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.510002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.510490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.510963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.520692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.522669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:40.537413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:40.538408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:40.539354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:40.542004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 461/925] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:40.550262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.650669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:40.658085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ab1b7-d2db-4eed-bebb-123f60ba830c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.694118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.694699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.694986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.695261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.696055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:40.696365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.697798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.716042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 465/926] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:40.722734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.831418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd09ac-2681-4397-8304-3f8e2bc37d63 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:40.871481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:40.872479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.872964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.873464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.884989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:40.886757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-47d04656-c6a6-44fd-afd1-5fe890df3ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:40.902257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:40.903206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:40.904077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:40.904077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:40.904077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:40.906193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 462/927] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:40.915135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:40.990709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c977-a211-4b07-89f5-15de65798a4e None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.990969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c977-a211-4b07-89f5-15de65798a4e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:40.991237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c977-a211-4b07-89f5-15de65798a4e None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:40.992842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 463/928] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:40.999451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:40.999825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.000704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.022207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:41.023427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:41.023783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129c36a-23a6-4935-b931-8ef2a7fa963b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.031960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.060718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.061489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.063198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.063496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.064164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:41.064473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.065863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.083353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 466/929] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:41.084417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.105517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.121799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 464/930] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:41.199150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23bed6-3813-430e-95f1-4df50236e9a6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.234841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.235471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.235760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.236043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.243069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.244504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-83a0597f-ecc4-4709-beeb-ea51e849f161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:41.256424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:41.257265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:41.258160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 467/931] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:41.268822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.330330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d04bf-7870-44bd-827e-f52486d1741a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.331210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d04bf-7870-44bd-827e-f52486d1741a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.331942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d04bf-7870-44bd-827e-f52486d1741a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.334424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 468/932] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:41.339190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.339690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.340170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.363139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:41.364332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:41.379530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b80b-cb63-443c-9452-ef7a7e841326 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.418028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.418648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.418931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.419212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.419904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:41.420216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.421631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.436894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.443485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 469/933] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:41.446079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 465/934] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:41.447819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.450740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.454416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.561795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf8d1-9dfc-41b8-a4f2-c41c8915f1a3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.561953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4024e2e-30d9-45d9-8da5-1d9812244e4f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.592672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.593564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.593921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.594205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/e7fb2436712f48e792e4ee5a6d33bdf1/roles/cee75ad79d9a4ecbbec3a84d69b0c0ec` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.594790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.595451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.595741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.596022 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.596443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=e7fb2436712f48e792e4ee5a6d33bdf1, role_id=cee75ad79d9a4ecbbec3a84d69b0c0ec)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.596617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.597957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.598070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:41.608806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:41.610359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:41.611226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 470/935] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:41.616519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.625840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 466/936] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:40:41 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/e7fb2436712f48e792e4ee5a6d33bdf1/roles/cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:40:41.706227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.718421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.744145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448026-1925-4645-b94b-26afed9559b3 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.787474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.788428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.788713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.788990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.789633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:41.790025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.791405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.796332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 471/937] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:41.803799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.812204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.871873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e115dd-03bb-4895-a676-74e51f999b03 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.917200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.917880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.918175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.918456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.919282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.921319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.927303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e70ac-2dd7-4120-b756-75484aafa4e7 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:41.932611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:41.933518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:41.939493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 467/938] 10.222.0.61 () {56 vars in 1132 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:41.940257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:41.967652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:41.976135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:41.977176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:41.977756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:41.978268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:41.979134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:41.979742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:41.981414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:41.989183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 472/939] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:41.994654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.063853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e91ea-ff29-4f02-a4ff-07926855f05c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.089009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:42.102589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.103211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.103550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.103890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.104533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:42.104839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.106246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.116179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 468/940] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:42.117123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.138943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924f7e2-fd24-4995-930c-4b8c53a5cf76 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.176210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.176884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.177172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.177453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.178237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] RBAC: Adding query filter params (interface=public, service_id=40c8f37f03584d9ca1328792941609ac, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:42.178662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.180146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.185938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 473/941] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:41 2022] GET /identity/v3/endpoints?service_id=40c8f37f03584d9ca1328792941609ac&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:42.191096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.243259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a8dd-87c9-4e0e-9f96-501cd0c79a7a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.276980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:42.279668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.280361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.280756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.281899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.282492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:42.282913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.284503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.290390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 469/942] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:42.297890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.325666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f630-069e-48a1-8984-75ab202d8cc9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.363214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.363827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.364156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.364441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.365433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.367137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e3fb9-69e9-47ed-a059-90b7c8c02e56 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.372668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:42.374767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 474/943] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:42 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:42.436156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc072-12c3-4343-82a2-b38467129c12 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.440073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480556-7e92-4e9a-b670-03fb22cd5999 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.440362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480556-7e92-4e9a-b670-03fb22cd5999 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.440641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480556-7e92-4e9a-b670-03fb22cd5999 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.443284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 475/944] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:42.449067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.449382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.449614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.473027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:42.475260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:42.480604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:42.481240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:42.481526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:42.481827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:42.482515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:42.483979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:42.514384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 470/945] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:42.585040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 476/946] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:42.860212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:42.964567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a785e-908c-4f10-8aad-f3fca1f1b67c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:42.974593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.001446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:43.002690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.003183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.003739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.004621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:43.006287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:43.009078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING keystone.server.flask.common [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 05:40:43.029079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.sql.core [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:40:43.029079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:40:43.029079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [parameters: {'id': '83d221150f464810996a90a6259a0e13', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:40:43.029079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 83d221150f464810996a90a6259a0e13.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 83d221150f464810996a90a6259a0e13. Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:40:43.046666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result.read() Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 05:40:43.047502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application yield resource Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise self.value Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application session.commit() Aug 24 05:40:43.048443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:40:43.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:40:43.050256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result.read() Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:40:43.051026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [parameters: {'id': '83d221150f464810996a90a6259a0e13', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:43.051851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:43.052606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 83d221150f464810996a90a6259a0e13. Aug 24 05:40:43.053484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:43.057481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 471/947] 10.222.0.61 () {60 vars in 1140 bytes} [Wed Aug 24 05:40:42 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:43.063623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:43.114423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.168914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db2d5-88db-4e2b-9944-150b9bbd0bd4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:43.205164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:43.205832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.206120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.206397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.213404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:43.214933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-5eb18f43-31cf-44d0-959f-47c89be51339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:43.226603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:43.227426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:43.228274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 477/948] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:43.234218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:43.340872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229f09-2646-4696-adda-43497a66f50c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:43.376310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:43.376845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.377184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.377468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.378168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:43.378475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:43.380101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba0f04-9978-4486-aa48-1e794d45c2ac None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:43.401447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 472/949] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:43.661420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698fc4-fc0c-421c-a156-8897b048d67d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.661927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698fc4-fc0c-421c-a156-8897b048d67d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.661927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698fc4-fc0c-421c-a156-8897b048d67d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.663437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 478/950] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:43.669340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.669935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.670426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.691971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:43.693956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:43.715157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.767713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 473/951] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:44.037370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84698fc4-fc0c-421c-a156-8897b048d67d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.141910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84698fc4-fc0c-421c-a156-8897b048d67d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.152796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.177893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.178531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.178820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.179159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.194919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:44.199507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:44.200396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:44.201222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 479/952] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:44.206743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.309815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d12a9-34dd-4f21-9270-d5a91045a67b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.347803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.349495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.350008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.350502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.351513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:44.352032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.353584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9720408-3156-4e11-8009-d482e2ff1e12 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.362412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 474/953] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:44.370463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.378183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e278-363f-4b3b-9983-940059f8f630 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.378476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e278-363f-4b3b-9983-940059f8f630 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.378757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e278-363f-4b3b-9983-940059f8f630 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.380111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 475/954] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:44.385166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.385467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.385750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.404041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:44.405244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:44.417317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.484072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 476/955] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:44.496806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f77a-f48e-447a-be95-f83d4f6208d2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.536058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.536695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.536979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.537258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.548837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.552433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-4d9dc265-1f0e-4ed0-bdbb-bd551a0f9896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:44.565461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:44.566465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:44.567365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:44.567365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:44.567365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:44.567365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 480/956] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:44.577788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.587410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87286-834d-459d-b5cf-e13ae00c0825 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.587951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87286-834d-459d-b5cf-e13ae00c0825 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.588444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87286-834d-459d-b5cf-e13ae00c0825 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.590139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 481/957] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:44.595832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.596327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.596745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.616048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:44.617690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:44.639079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.694125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673272c-03ed-4bcb-a8a1-6d6b253342f6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.702210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 482/958] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:44.730326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.730941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.731222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.731497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.732143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:44.732448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.733823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.745680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 477/959] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:44.753324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.800966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.810874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.867763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06557ba7-fc62-42a2-9f67-415f15c2e52e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.904846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.905658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.906099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.906479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.909989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c360b0e-3c4f-4842-ba3b-37a5123d6882 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.914333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.915963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:44.928145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:44.929279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:40:44.930482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:44.936815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 483/960] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:44.938801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:44.954519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.955614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.956112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.956606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.957407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.959019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.961515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:44.970371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:44.971559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:44.972458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 478/961] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:44.973282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.049999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515e4f-b3b0-47c2-885a-b74d87d17465 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.059107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.086498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.087112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.087390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.087665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.088402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.088710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.090161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.094212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c29a9-353f-4556-b306-2811ff27e96a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.107703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 484/962] 10.222.0.61 () {56 vars in 1149 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.108527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.137440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.138072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.138297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.138572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.139152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.140614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:45.150587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:45.151671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:45.152490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:45.154106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 479/963] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:45.154974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.188295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.221830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b48c4-677b-4e7f-b316-2eb6010013a1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.258066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.258675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.258982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.259222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.259899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.260142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.261491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.263037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbb6e4-5e99-44b7-b9fe-f13573016e8f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.266625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 485/964] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.267294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.304204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.304819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.305103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.305380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.308193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.373668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f309a-ce21-4ef0-86d4-e48bcdc9ae20 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.379421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.380872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.412697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.413540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.414033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.414472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.415279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.415590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.416987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.418241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.423592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 486/965] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.424564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.499251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 480/966] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:45.500501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.534282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395ed8-3b00-4fd8-9f25-a68f89711c0f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.534919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.574160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.574795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.575075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.575347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.575975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.576277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.577634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.582398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 487/967] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.583168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.609083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dbea-8986-4a6c-b24c-619799b4cc28 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.642113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.642898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.643529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.643838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.644093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.644775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:45.645064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.646446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cd72e-24d9-4c72-aef9-29de25f20b5f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.651144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 481/968] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:45.652234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c1b-65ca-495e-b316-22763283ccc1 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.652522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c1b-65ca-495e-b316-22763283ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.652795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422c1b-65ca-495e-b316-22763283ccc1 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.654047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 482/969] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:45.654751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422c1b-65ca-495e-b316-22763283ccc1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.700923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334b3c-539b-4f51-a316-da263bc1846e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.748041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.748744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.748977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.749259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.760450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.761986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.767894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:45.774117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422c1b-65ca-495e-b316-22763283ccc1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-802920b3-e850-4e4c-ba24-26747ad371cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:45.778890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:45.780044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:45.781735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:45.781735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:45.781735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:45.783213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 488/970] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:45.784620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.785052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.785465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.804785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:45.805691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:45.821431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:45.822361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:45.822906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:45.823352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:45.824321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:45.825699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:45.852275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 483/971] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:45.853105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:45.891989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 489/972] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:45.988703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfbe8d-bb31-46bb-aa45-61f9f37c0bee None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.026252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.026871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.027156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.027435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.028080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:46.028388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.029782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.042907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 484/973] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:46.048469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.092020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.152363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf4b2-f07e-4746-9d5c-58c6b2313081 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.170713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.188717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.189195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.190168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.190456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.190734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.199590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.201685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:46.216047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:46.216954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:46.217840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:46.218363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 490/974] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:46.223733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.283619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3b7d3-3573-49bd-bc48-b6a1e86a9107 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.323070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.323812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.324103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.324389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.325211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.325496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.327156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.330036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0fef-5bbb-4af3-b645-191a0990cb28 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.345510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.sql.core [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:40:46.345510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:40:46.345510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [parameters: {'user_id': 'e564a77b5fb94c9194985818c0983465', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:40:46.345510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result.read() Aug 24 05:40:46.354662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:40:46.356639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application yield resource Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise self.value Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application session.commit() Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:40:46.357789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:40:46.358884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:40:46.360068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application result.read() Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:40:46.361080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e564a77b5fb94c9194985818c0983465', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:46.370301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 05:40:46.371101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 485/975] 10.222.0.61 () {60 vars in 1131 bytes} [Wed Aug 24 05:40:46 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:46.372037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.385499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.386389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.386812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.387226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.388143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:46.388658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.391035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.409666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 491/976] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:46.414931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.451971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.478180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3369c2-ef7e-4709-af4e-ddd6d24ffa92 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.513177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.514177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.514665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.515136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.523435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.525370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.532648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec561246-0ccc-40f8-8afc-b0845d18ac37 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:46.537953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:46.538858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:40:46.539781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:46.542289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 486/977] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:46.549875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.573446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.574006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.574298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.574578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.575317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] RBAC: Adding query filter params (role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=e7fb2436712f48e792e4ee5a6d33bdf1) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:46.575630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.577213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eafd9-ba08-4c3c-9762-f682295d0e4e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.589945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 492/978] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/role_assignments?user.id=e7fb2436712f48e792e4ee5a6d33bdf1&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:46.678951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd700d-a076-4038-bb57-5da4688b1537 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.716879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.717871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.718345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.718859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.719808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:46.720341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.722024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe541f-4305-45d5-9221-0cccea310f44 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.734006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.764342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 487/979] 10.222.0.61 () {56 vars in 1101 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:47.621406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4811-f4dc-43a4-8db9-e3a5c6929dd8 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.621940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4811-f4dc-43a4-8db9-e3a5c6929dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.622015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4811-f4dc-43a4-8db9-e3a5c6929dd8 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.623482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 493/980] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:47.628671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fab3-af7b-4a27-a130-9d25575a61ec None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.629061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fab3-af7b-4a27-a130-9d25575a61ec None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.629241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713fab3-af7b-4a27-a130-9d25575a61ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.648027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f713fab3-af7b-4a27-a130-9d25575a61ec None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:47.649845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f713fab3-af7b-4a27-a130-9d25575a61ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:47.720111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 488/981] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:47.842132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d58-50b6-453a-a4a6-851070566e54 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.842423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d58-50b6-453a-a4a6-851070566e54 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.842605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d58-50b6-453a-a4a6-851070566e54 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.844143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 494/982] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:47.849373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:47.849667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:47.849974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:47.867849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:47.869095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:47.933804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 489/983] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:47.984957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e763d58-50b6-453a-a4a6-851070566e54 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.009988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.084226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e763d58-50b6-453a-a4a6-851070566e54 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.117645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.118224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.118508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.118779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.119423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.120781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.138690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 495/984] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:47 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:48.204360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.266480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.316976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd8f0a-44db-4bd7-b213-227e29a3c7e3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.357645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.358305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.358590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.358865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.359990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.361347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:48.369977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:48.370933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:48.372145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 490/985] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:48.377688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.462935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.482994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b40d-4796-4b0b-b069-c18d10ac595b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.517645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.518301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.518583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.518858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.519540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:48.519853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.521265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd06d9-7643-49bf-95ea-0e44d03c52e1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.530538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 496/986] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:48.532212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.569107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae00c-1f8c-448d-80ac-32970075cd60 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.569107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae00c-1f8c-448d-80ac-32970075cd60 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.569107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae00c-1f8c-448d-80ac-32970075cd60 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.570014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 497/987] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:48.574997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.575514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.575947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.594449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:48.595631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:48.648343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96042bc-5835-489a-a72b-552b02dd9212 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.662138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.677912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 498/988] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:48.691143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.691762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.692044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.692317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.692945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:48.693332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.695021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.700208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 491/989] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:48.706584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.788755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:48.812083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7362a4-849e-4443-9f3d-ab0cce5e891a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:48.847516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:48.848187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.848478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.848754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.849784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] RBAC: Adding query filter params (interface=admin, service_id=40c8f37f03584d9ca1328792941609ac, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:48.850099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:48.851467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:48.861624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 499/990] 10.222.0.61 () {56 vars in 1249 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/endpoints?service_id=40c8f37f03584d9ca1328792941609ac&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:48.862861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.939373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:48.967448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24571488-3b35-4b98-b281-332ad59fd802 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.006490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.007113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.007402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.007682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.008298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.009700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.016360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 492/991] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:49.055193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63005-67e7-4e85-9a8d-34e10495b34a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.094067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.094780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.095067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.095345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] PATH_INFO: `/v3/services/image` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.095960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.097379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:49.107268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:49.108316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:49.109629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:49.111199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 500/992] 10.222.0.61 () {56 vars in 1105 bytes} [Wed Aug 24 05:40:48 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:49.115019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:49.161972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.224417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aafa8-9c22-43f4-9c58-0c026c13bc6f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.260781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.261397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.261682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.261984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.262619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] RBAC: Adding query filter params (name=image) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:49.262927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.264280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f212f-2683-4936-ba41-5fdc406ed88a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 493/993] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:49.274795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:49.284661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.378233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daef00-0643-4544-8d86-17a4229f0969 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.411126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.411738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.412021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.412298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.412930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] RBAC: Adding query filter params (type=image) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:49.413236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.414623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923c9a-523d-4e74-a734-866dfa8dc330 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.425851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 501/994] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:50.057745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844f59-3da6-4a1a-8ae0-a6e46a57ea54 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.058383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844f59-3da6-4a1a-8ae0-a6e46a57ea54 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.058383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844f59-3da6-4a1a-8ae0-a6e46a57ea54 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.060005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 494/995] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:50.065023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.065429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.065592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.083157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:50.084324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:50.151702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:50.160966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 502/996] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:50.420588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4844f59-3da6-4a1a-8ae0-a6e46a57ea54 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:50.524521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4844f59-3da6-4a1a-8ae0-a6e46a57ea54 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:50.532063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:50.565009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:50.565646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.565961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.566236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.566821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:50.568173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:50.580602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:50.581598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:50.585453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 495/997] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:50.588095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:50.691597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e7a5e-e80d-427f-9ee1-1f33baa6d056 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:50.726575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:50.727190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.727474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.727750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.728380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] RBAC: Adding query filter params (name=compute) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:50.728687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:50.730065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:50.739830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 503/998] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:50.741068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:50.848987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623002a-7dec-403f-b7d5-8477d6776d36 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:50.884069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:50.884687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.884979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.885258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.885924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:50.886234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:50.887609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ebbd-a0e3-43f8-bf0c-6ce8981077a6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:50.892720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 496/999] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:50.898424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:50.955673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3f00-4fa4-4ff2-bd0d-beb7e9d66bda None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.955869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3f00-4fa4-4ff2-bd0d-beb7e9d66bda None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.956198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f3f00-4fa4-4ff2-bd0d-beb7e9d66bda None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.957676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 497/1000] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:50.961784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:50.962585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:50.962869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:50.963173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:50.982354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:50.983545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:51.003943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0b99-fe01-4a85-9fd2-0c2570fd9cac None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.011002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.042314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.042924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.043209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.043483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.044184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] RBAC: Adding query filter params (interface=public, service_id=50aa11d1d3624fcc883affb8a773cc51, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:51.044495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.045884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.055774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 504/1001] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:50 2022] GET /identity/v3/endpoints?service_id=50aa11d1d3624fcc883affb8a773cc51&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:51.057052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.061807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 498/1002] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:51.166009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7904e7-6ca3-4476-a30a-8aab7bb32082 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.192415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.201133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.201987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.202408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.203380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.204144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.205636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d597b7-060a-4c44-b7b7-e21229b9520f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.212437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 505/1003] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:51 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:51.326737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.333098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba577-3d50-416b-80b2-c83d0d9d8bf3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.333448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba577-3d50-416b-80b2-c83d0d9d8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.333654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba577-3d50-416b-80b2-c83d0d9d8bf3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.335073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 506/1004] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:51.340606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.340893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.341175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.360230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:51.361425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:51.432661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 507/1005] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:51.447441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7bf3a-4255-4119-a68e-1b4756e2a917 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.482834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.483407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.483753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.484060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.484646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.486036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:51.494707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:51.495671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:51.497069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 499/1006] 10.222.0.61 () {56 vars in 1126 bytes} [Wed Aug 24 05:40:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:51.502234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.612515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85330b3-4156-4227-bd1b-b6bdf3cb5b71 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.636207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.649169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.649804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.650093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.650372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.652565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:51.652565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.652766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.662353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 508/1007] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:51.663903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.695086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.700788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.775596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3faf-487a-43c7-bd0e-600c95854fda None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.808868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a4bae-6e46-44d5-b6e0-f6c421d2e354 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:51.823288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.824654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.825261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.825868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.826935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:51.827443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.828994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.834339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 500/1008] 10.222.0.61 () {56 vars in 1122 bytes} [Wed Aug 24 05:40:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:51.839832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:51.849799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:51.850422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.850710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.850993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.851653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:51.853026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5c5e8-ee28-44af-b425-fe284d47698d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:51.868981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 509/1009] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:51.949179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.960555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6941a6-ed32-453a-a43f-4289bcc2d745 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.003474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.004365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.004365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.004634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.005814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.006877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df144-5dfd-4ec5-b43a-5f354d5e3f75 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.025553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 501/1010] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:53.091236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632573-4875-4026-a22a-2d8c644cf1ba None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.091779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632573-4875-4026-a22a-2d8c644cf1ba None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.091779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45632573-4875-4026-a22a-2d8c644cf1ba None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.093801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 510/1011] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:53.099125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.099502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.099675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.118965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:53.120162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:53.197801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 502/1012] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:53.460321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632573-4875-4026-a22a-2d8c644cf1ba None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.510870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:53.575066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45632573-4875-4026-a22a-2d8c644cf1ba None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.610375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.611010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.611299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.611577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] PATH_INFO: `/v3/services/compute` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.612159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.613531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:53.622493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:53.623466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:53.626576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 511/1013] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:53.630180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.707692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:53.735297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d22a-0beb-497c-a077-8cdfc32db597 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.770379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.770997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.771280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.771557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.772187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] RBAC: Adding query filter params (name=compute) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:53.772491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.773972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad2b8a-d9b9-4860-9b6e-3d1ca9e51bdc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.783449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 503/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:53.784612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.796495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb7ea-3221-493b-9f8c-af520cf3bd1a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.796789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb7ea-3221-493b-9f8c-af520cf3bd1a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.797054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb7ea-3221-493b-9f8c-af520cf3bd1a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.798440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 504/1015] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:53.803783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53123c-1c47-48bd-90cd-2012ec23d2ab None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.804141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53123c-1c47-48bd-90cd-2012ec23d2ab None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.804422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53123c-1c47-48bd-90cd-2012ec23d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.823259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0b53123c-1c47-48bd-90cd-2012ec23d2ab None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:53.824447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0b53123c-1c47-48bd-90cd-2012ec23d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:53.890629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecc70f-f2c9-46e0-811f-eaeffebeaa6b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:53.893817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 505/1016] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:53.908610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:53.932956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf7fe-dcc6-44cd-ac6b-8beeb3da6567 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.933270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf7fe-dcc6-44cd-ac6b-8beeb3da6567 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.933451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:53.933581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf7fe-dcc6-44cd-ac6b-8beeb3da6567 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.934092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.934381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.934657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.937817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 506/1017] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:53.937946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:53.937946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:53.937946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:53.940624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:53.940908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:53.941182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:53.944296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 512/1018] 10.222.0.61 () {56 vars in 1112 bytes} [Wed Aug 24 05:40:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:53.948998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:53.960352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:53.961641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:54.026928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.035728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 507/1019] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:54.052766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb328-ffc5-45a4-8329-a72693fb01e0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.086157 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.086812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.087096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.087369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.088016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.089363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.113807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 513/1020] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:54.160980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.273305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45847652-0456-4f71-ac5e-5aec8506821d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.313545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.314485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.315144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.315432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.315711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.316305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.317672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:54.329546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:54.330585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:54.331431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 508/1021] 10.222.0.61 () {56 vars in 1105 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:54.336532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.349857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.404556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.435249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550afc7-5ae8-4aa5-b7d7-634ac6aa3e6d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.451388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192a973-09ff-4990-a1b9-80d5bf9bc3a4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.471629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.472264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.472544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.472814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.474229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.475658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.477802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 514/1022] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:54.482934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.492824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.493894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.494191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.494474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.495125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] RBAC: Adding query filter params (name=image) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:54.495439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.497170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.503020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 509/1023] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:54.509374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.589427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.593257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcf0b-6fd5-4c3c-bf62-2a264dcf324e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.625693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263e8b-2d30-4ed0-86a4-445ca7b1ba6d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.628010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.628697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.629045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.629327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.630010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.631439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.649735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.661407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 515/1024] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:40:54 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:54.665254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.665931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.666220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.666501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.667152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] RBAC: Adding query filter params (type=image) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:54.667497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.669162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.675949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 510/1025] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:54.682160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.793409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035851dd-bfca-4976-9ffe-637f235a396a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.829221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.829866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.830146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.830429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.831148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] RBAC: Adding query filter params (interface=public, service_id=a47d62c5793743bba893b0a283b8696d, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:54.831462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.832833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f1e-01fd-46d9-876b-32d94048a57e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:54.838298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 516/1026] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/endpoints?service_id=a47d62c5793743bba893b0a283b8696d&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:54.844259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.947728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3e1c5-f36c-4506-9b5f-36ab809a553c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:54.985454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:54.986089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.986377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.986652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.987259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:54.988629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d44e5c-9f30-4621-b3f8-4388cde9f771 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:55.001795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 511/1027] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:56.115059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9083-59b0-408e-a24c-9b5b5b6f5c19 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.115586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9083-59b0-408e-a24c-9b5b5b6f5c19 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.115586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9083-59b0-408e-a24c-9b5b5b6f5c19 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.117115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 517/1028] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:56.122286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf04d-2b0b-45e4-9b5b-c52ff1365f8c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.122662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf04d-2b0b-45e4-9b5b-c52ff1365f8c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.122839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf04d-2b0b-45e4-9b5b-c52ff1365f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.140798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-bf4bf04d-2b0b-45e4-9b5b-c52ff1365f8c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:56.142042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bf4bf04d-2b0b-45e4-9b5b-c52ff1365f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:56.189337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.212203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 512/1029] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:56.482143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e9083-59b0-408e-a24c-9b5b5b6f5c19 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:56.498018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.596125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e9083-59b0-408e-a24c-9b5b5b6f5c19 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:56.630058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:56.630699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.630985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.631262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.638799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba06d-4241-48cd-bad3-2ea48ba4cb39 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.639089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba06d-4241-48cd-bad3-2ea48ba4cb39 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.639376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba06d-4241-48cd-bad3-2ea48ba4cb39 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.641368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 513/1030] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:40:56.643167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:56.646700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.646993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.647273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:56.648013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:56.648908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:56.649739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 518/1031] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:40:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:56.654722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:56.667305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:56.668845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:56.736825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.743587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 514/1032] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:56.765926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70973e-a151-44df-af4d-1348eefe86e5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:56.800908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:56.801517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.801822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.802106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.802834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:56.803146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:56.804571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca44b2-b992-4c1e-b1a9-66baf08c5292 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:56.818144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 519/1033] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:40:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:56.819070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:56.923389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173b65-35ea-4770-8c98-d94dd9e79333 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:56.934904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.960397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:56.961115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.961402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.961677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.965602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a035-ff9c-40b3-b5a6-f91a65cf63a0 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.965947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a035-ff9c-40b3-b5a6-f91a65cf63a0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.966235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a035-ff9c-40b3-b5a6-f91a65cf63a0 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.967700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 520/1034] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:56.972381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:56.972576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:56.972832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:56.973109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:56.974164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:56.989037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:56.995141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:56.996149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:56.996149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:56.996149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:56.996149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 515/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:56.996388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:56.996388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:56.996514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.063504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 521/1036] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:40:57.064344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.102979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e991d-1bb9-4686-8bd2-6647f1cb43b5 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.130394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.139194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.139844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.140132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.140420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.141070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:57.141379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.142787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.155009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 516/1037] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:57.160259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.175781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3de0f-c225-4f84-8fa1-f98810a04d70 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.186282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.213578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.214235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.214523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.214804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] PATH_INFO: `/v3/domains/default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.216071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.217509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.219638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 522/1038] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:57.225352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.270517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37f950-aa8f-4412-a60d-28e3a7c088f4 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.306735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.307366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.307651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.307922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.315959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.317386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:40:57.328572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:57.329503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:57.330865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 517/1039] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:57.335241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.335576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3ac3-bb85-4fb4-a96b-980a5160cdad None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.371233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.371846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.372135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.372414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.373059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.375232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.383016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.397850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 523/1040] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:40:57 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:40:57.398723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.429978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.451363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055324ab-27b7-4312-8244-2c39fe3c89f0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.488988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.489621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.489943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.490226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.490979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:57.491289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.492751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.516538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 518/1041] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:57.517706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.521404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7524ee-39b1-4e73-ab48-0753561a27d9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.562642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.563302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.563593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.563875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] PATH_INFO: `/v3/services/image` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.564471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.565878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:57.575130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:57.576371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:57.577224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 524/1042] 10.222.0.61 () {56 vars in 1105 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:57.581981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.642227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6f8b3-dbdf-4437-ad14-939534c45bf1 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.646254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.684052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.685050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.685532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.685911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.696433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311984dd-c6c8-4ef2-946c-69040079c549 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.698015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.730538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.731147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.731426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.731699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.732325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] RBAC: Adding query filter params (name=image) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:57.732628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.734102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.739384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 525/1043] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:57.745066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.769202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.770681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.856410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead5665-428a-4e65-890d-b23a102e1b8b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.876495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.880211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 519/1044] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:57.886059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.900183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.900806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.901087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.901362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.902020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] RBAC: Adding query filter params (type=image) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:57.902324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.903682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.909810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 526/1045] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:57.916289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.929637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.993515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931831-cdf0-4d85-a0c5-67b735ea7208 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.021203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3a076-3d64-4cab-80cf-94f9489f72ae None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.031102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.031967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.032253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.032530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.043280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.044826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.054101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.054704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.054992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.055266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.055931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.057284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:40:58.062487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:58.063615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:40:58.064851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:40:58.064851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:40:58.064851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:58.064851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 520/1046] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:58.069079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:58.087508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 527/1047] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:40:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:40:58.171913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:58.182925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213f7bd-fea6-4535-8858-fb8e48c45ba8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.224916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.226209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.226490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.226761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.227404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:58.227708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.229066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.242229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 521/1048] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:58.247876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:58.290121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:58.353885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0841-be57-4171-af87-e6d20ade97e5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.387508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.388530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.389015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.389523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.396753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.398525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:40:58.410714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:58.411683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:40:58.412559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:40:58.414660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 528/1049] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:40:58.423137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:58.526299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc233316-4466-464a-8de0-38d62def13a0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.565848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.569264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.569264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.569264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.569264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:58.569264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.569626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9991a-5c8f-4e07-9261-7d5f807284d9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.587302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 522/1050] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:40:58.594173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:58.694560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:58.699144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6c45-5935-43a5-be03-24b344dbb3dd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:58.733966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:58.734578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:58.734864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:58.735141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:58.735867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] RBAC: Adding query filter params (role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:40:58.736181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:58.737758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7993c-0dd4-4677-85d0-f7772fea368e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:58.750033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 529/1051] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:40:58 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:40:59.353755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd204d-d52e-44e6-9f59-2fd1bcfc9694 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.354289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd204d-d52e-44e6-9f59-2fd1bcfc9694 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.354476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd204d-d52e-44e6-9f59-2fd1bcfc9694 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:59.355843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 523/1052] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:59.360848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.361235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.361395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:59.379106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:59.380273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:59.445932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 530/1053] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:40:59.709499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd204d-d52e-44e6-9f59-2fd1bcfc9694 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:59.721374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:59.814727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd204d-d52e-44e6-9f59-2fd1bcfc9694 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:59.847911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:59.848793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.849074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.849347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:59.860244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:40:59.864799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:40:59.865732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:40:59.866840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:40:59.869854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 524/1054] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:40:59.871821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:59.959799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:59.970463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061882e0-a15e-4788-8b46-176cafb2a17a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.003984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.004588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.004868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.005144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.005822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:00.006127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.007472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675c2f-656d-4ab5-b6d6-0c3c13e6805e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.016066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 531/1055] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:00.021581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.055247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468b28-8cfc-4438-864e-9fb235f375c8 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.055546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468b28-8cfc-4438-864e-9fb235f375c8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.055825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468b28-8cfc-4438-864e-9fb235f375c8 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.057432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 532/1056] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:41:00.062226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.062513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.062791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.081259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:00.082457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:00.090025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.127159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e6ad-fc70-4fd0-848c-0b01924dc275 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.153749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 533/1057] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:41:00.165614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.166293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.166711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.166992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] PATH_INFO: `/v3/users/6da8e17105c849799b8dbbd2e1509d6f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.180659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] RBAC: Authorizing `identity:get_user(user_id=6da8e17105c849799b8dbbd2e1509d6f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.182148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.183804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 525/1058] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/users/6da8e17105c849799b8dbbd2e1509d6f => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:00.189700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.276706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.295250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f311869-7f46-4e3d-a81e-d61505fa5f77 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.329085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.329809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.330162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.330504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.396463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.397937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.427782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.483039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.503440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 534/1059] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:00.508980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.540633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afe9d8-25c8-4793-b893-5207594aff8d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.574146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.586322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734443-9da8-4936-b655-a38a69109914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.588438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734443-9da8-4936-b655-a38a69109914 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.588734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734443-9da8-4936-b655-a38a69109914 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.589046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734443-9da8-4936-b655-a38a69109914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.620253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119020d-7c2d-451f-8b24-8fd70e34af4d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.655438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.656099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.656390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.656670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.657825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.658135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734443-9da8-4936-b655-a38a69109914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.659268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bf761-451b-44b2-8163-0ed3db5758e9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.659615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734443-9da8-4936-b655-a38a69109914 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.660902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 535/1060] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:00.662058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc8c7-c6c4-4540-8a86-69dd92ae4ac4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.662348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc8c7-c6c4-4540-8a86-69dd92ae4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.662626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc8c7-c6c4-4540-8a86-69dd92ae4ac4 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.663821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 536/1061] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:00.666643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebc8c7-c6c4-4540-8a86-69dd92ae4ac4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.720361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.765428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 526/1062] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:41:00.766563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.766854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.767135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.768780 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebc8c7-c6c4-4540-8a86-69dd92ae4ac4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.784194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:00.785394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:00.805527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.806112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.806392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.806665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.807399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=89acb3eb235a4ceea8136ed3baedfe19, user.id=6da8e17105c849799b8dbbd2e1509d6f) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:00.807711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.809135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.812797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.815336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 537/1063] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/role_assignments?user.id=6da8e17105c849799b8dbbd2e1509d6f&scope.project.id=89acb3eb235a4ceea8136ed3baedfe19&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:00.816124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.871643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 527/1064] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:00.928993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591bfd7-b9b9-4cf7-af7c-f7b0b2bb7e60 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.947537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.968571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.969309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.969672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.970071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.980974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.982548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:00.997803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:00.999005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:41:01.000546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:01.000546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:01.000546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:01.001202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 538/1065] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:01.006963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.107866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21636-0904-4bb7-a1e1-68456dfd1cfd None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.142354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.142973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.143508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.143508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.144165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:01.144472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:01.144569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.145862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:01.159890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 528/1066] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:01.254223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8c6f-edd8-44d6-91a1-ea80bbcd3dc5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.290721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.291373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.291659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.291936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.303911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:01.309069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:01.310053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:01.311100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 539/1067] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:01.316664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.335906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:01.423841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfa15d-8197-46a7-85aa-8c8772d09df0 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.459564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.460176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.460456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.460733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.461400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:01.461705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:01.463089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:01.472229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 529/1068] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:01.478204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.507665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:01.580632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be338cb-6e91-41f1-9d0e-156121b1fd8a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.613375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.614106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.614389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.614664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.625282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:01.626726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:01.640582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:01.646648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:41:01.647795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:01.647795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:01.647795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:01.647795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 540/1069] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:01.648054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.724389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:01.745981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d989e-ef88-4b98-ae07-72752e743bcf None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.779135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.779741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.780030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.780307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.780953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:01.781259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:01.782643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:01.793577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 530/1070] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:01.799786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:01.882627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:01.901995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f348-354d-4e66-a9d8-95925cd9fa55 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:01.936232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:01.936897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:01.937179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:01.937453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:01.945661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:01.947131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:41:01.957895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:01.958962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:01.959932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 541/1071] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:01.964888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.061495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9e89-4e02-4f77-bc86-bea3e997ab49 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.093608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.094239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.094523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.094794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.095518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:02.095822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.097230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.105507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:02.115814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 531/1072] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:41:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:02.121360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.216482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e929c8-4337-49cb-8b8f-69707eb8f178 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.250267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.250890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.251172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.251445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.259987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:02.262575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.265084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:02.279480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:02.281193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:41:02.282246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:02.282246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:02.282246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:02.282246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 542/1073] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:41:02.286914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.383960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a308-9f43-452f-a8c3-0b7a4083e47d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.417919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.418529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.418814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.419090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.419750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:02.420038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.421429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.432381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 532/1074] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:02.438015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.538387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939e7b-86db-4e4b-b57b-d53bf6edf475 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.573635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.574297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.574584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.574858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.581983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.583427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-82b24a1d-1e01-4b05-8df1-d3f32d4d52ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:41:02.594913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:02.595774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:02.596649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 543/1075] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:02.602058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.657361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:02.682857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a630f-440b-4352-9f73-f0c606351a61 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.683149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a630f-440b-4352-9f73-f0c606351a61 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.683429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a630f-440b-4352-9f73-f0c606351a61 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.684760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 544/1076] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:02.690343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.690629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.690909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.703215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35a0d7-7c45-4ee5-870c-258df59aed8e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.709561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:02.710772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:02.737418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.738050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.738333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.738606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.739288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:02.739590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.740998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.752984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 533/1077] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:02.756700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:02.759067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:02.779535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 545/1078] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:41:02.854536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064adf-3d7e-4727-8318-8f6b05e094f2 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:02.870140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:02.888511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:02.889172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:02.889489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:02.890402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/cee75ad79d9a4ecbbec3a84d69b0c0ec` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:02.892560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=640894aa402744af861080d8d0d80f66, role_id=cee75ad79d9a4ecbbec3a84d69b0c0ec)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:02.894025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:02.906528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 534/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:41:02 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/640894aa402744af861080d8d0d80f66/roles/cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:41:03.042363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:03.139637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dd578-9ca0-4f24-852c-4c21aab89a15 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:03.172671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:03.173303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:03.173595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:03.173911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:03.183905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:03.189152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:03.190223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:03.194927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 546/1080] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:03.196207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:03.294031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b912a2-1509-45d2-9b9b-07c7e3e8eb4e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:03.330200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:03.330806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:03.331086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:03.331358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:03.332021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:03.332332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:03.333688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:03.341746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 535/1081] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:03.347533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:03.391301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:03.446979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9c5b0-ba3d-4dc0-80bc-8f7d1d9f86c1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:03.479797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:03.480415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:03.480697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:03.480971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] PATH_INFO: `/v3/users/6da8e17105c849799b8dbbd2e1509d6f` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:03.482106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] RBAC: Authorizing `identity:get_user(user_id=6da8e17105c849799b8dbbd2e1509d6f)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:03.484124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:03.485840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 547/1082] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:03 2022] GET /identity/v3/users/6da8e17105c849799b8dbbd2e1509d6f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:03.491591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:03.530827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:03.593250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f6db3-e303-426b-82fc-d8ae6f76031a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:03.625876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:03.626509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:03.626788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:03.627060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:03.628153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:03.629572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370948-6e8c-49c5-bbb9-f623d3d5a973 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:03.631200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 536/1083] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:03 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:03.637569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:03.735458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2825-5a5c-40b1-9ad3-fdc526bb4e35 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:03.745929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:03.769317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:03.770065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:03.770350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:03.770627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19/users/6da8e17105c849799b8dbbd2e1509d6f/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:03.772479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] RBAC: Authorizing `identity:create_grant(project_id=89acb3eb235a4ceea8136ed3baedfe19, user_id=6da8e17105c849799b8dbbd2e1509d6f, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:03.773919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081527c3-4f44-4d28-900e-3329a8d7e97c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:03.786775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 548/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:41:03 2022] PUT /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19/users/6da8e17105c849799b8dbbd2e1509d6f/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:04.775304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55840-b244-4825-822a-5903f3c28da7 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:04.775817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55840-b244-4825-822a-5903f3c28da7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:04.775933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55840-b244-4825-822a-5903f3c28da7 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:04.777193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 537/1085] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:04.782532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:04.782924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:04.783205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:04.801344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:04.802470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:04.869183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 549/1086] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:05.132086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55840-b244-4825-822a-5903f3c28da7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.232976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55840-b244-4825-822a-5903f3c28da7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.240486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:05.268290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.268926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.269212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.269496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.279520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:05.284808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:05.285899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:05.286727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 538/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:05.291930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.388128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:05.391575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c90da-eb81-4fdb-86e5-18ff2a17a589 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.426144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.426754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.427039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.427319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.427983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:05.428290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:05.429748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.437642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 550/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:05.443260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.542061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d524-242e-462d-81b9-d9239327d0c9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.577268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.577949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.578232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.578507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.588233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:05.589661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a3adfc91-f388-47fa-b432-8468584c2120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:05.604336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:05.605375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:41:05.606383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:05.606383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:05.606383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:05.606383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 539/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:05.611721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.662538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96ae1-cc3c-46f0-aeff-8b5aee62dbf3 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.662752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96ae1-cc3c-46f0-aeff-8b5aee62dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.663033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96ae1-cc3c-46f0-aeff-8b5aee62dbf3 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.664502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 540/1090] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:41:05.669851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.670146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.670430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.688518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:05.689699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:05.702528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:05.712676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd81ce-b3b9-4053-a526-ae4d66fd2364 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.746693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.747296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.747581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.747865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.748510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:05.748844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:05.750250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.757794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 541/1091] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:05.761943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 551/1092] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:05.767454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.863587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d03789-61c3-42f9-93aa-062aeadc887f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:05.895659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:05.896282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:05.896566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:05.896843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] PATH_INFO: `/v3/users/nova` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:05.903607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:05.905527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:41:05.916636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:05.917704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:05.918683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 542/1093] 10.222.0.61 () {56 vars in 1093 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:05.923914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:05.948174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.022087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.022464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba82cf-3699-4018-8150-d33e27ab2913 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.033065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.059093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.059707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.059996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.060275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.061006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:06.061937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.063411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.080415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 552/1094] 10.222.0.61 () {56 vars in 1133 bytes} [Wed Aug 24 05:41:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:06.085676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.124681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d144-2ee4-48fe-b0de-061c061986da None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.157342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.157996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.158275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.158550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.163533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.169216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:06.174334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:06.175313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:06.176121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:06.180307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 543/1095] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:41:06.181163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.183888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6f3b2-e673-41bb-ad85-db83215728e6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.220644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.221254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.221542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.221856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.245258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.280602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52da6b1-b625-4933-8651-d55dd0494e07 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.290540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.291984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.313664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.314484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.314766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.315051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.315716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:06.316025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.317371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.326128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 544/1096] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:06.331856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.371001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.391653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 553/1097] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:41:06.397302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.430800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725dc01-185b-4bdb-b7cf-999c13d12e26 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.458207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.464236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.464874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.465154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.465427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] PATH_INFO: `/v3/users/6da8e17105c849799b8dbbd2e1509d6f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.466608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] RBAC: Authorizing `identity:get_user(user_id=6da8e17105c849799b8dbbd2e1509d6f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.468532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.470130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 545/1098] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/users/6da8e17105c849799b8dbbd2e1509d6f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:06.476192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.494614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f3d6-6bd4-4680-91ae-b828d7ca3269 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.528822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.529454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.529742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.530556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.540920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.542397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:06.557641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:06.558590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:41:06.559633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:06.559633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:41:06.559633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:06.559633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 554/1099] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:41:06.564318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.577049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ef85-fcd5-4782-adac-86d7e0ec6b3d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.594493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.612199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.612808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.613099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.613378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.662955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbb480-0a28-439b-97cd-0464dbc98013 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.677133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.681384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.682936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.696667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.697284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.697559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.697864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.698515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:06.698821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.700172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.712271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 555/1100] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:06.718370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.781329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 546/1101] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:41:06.787119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.808417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.818118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d1d16-a227-4c56-a561-77294af5933b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.853597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.854289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.854574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.854851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.862738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.864174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:41:06.874989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:06.875870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:06.876929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 556/1102] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:41:06.881286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:06.881805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.885355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26085c-4eb8-4146-8de2-7b98bb512a32 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:06.919176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:06.919801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:06.920084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:06.920368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:06.921503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:06.922963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:06.924721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 547/1103] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:06.930426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:06.979150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274e37-2415-41e5-b6c9-945e7eb99ed1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:07.012104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:07.012707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:07.012988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:07.013263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:07.013978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:07.014790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:07.016204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:07.027746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 557/1104] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:07.027885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9870-8fab-428c-9e7e-f97ed8145154 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:07.034367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:07.048035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:07.062518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:07.063125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:07.063407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:07.063679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:07.064398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=89acb3eb235a4ceea8136ed3baedfe19, user.id=6da8e17105c849799b8dbbd2e1509d6f) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:07.064701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:07.066138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77253a-354c-4404-96d0-c61dd499dbe4 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:07.071892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 548/1105] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:06 2022] GET /identity/v3/role_assignments?user.id=6da8e17105c849799b8dbbd2e1509d6f&scope.project.id=89acb3eb235a4ceea8136ed3baedfe19&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:07.136654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e9f30-0820-4cbf-a22d-dd0717ed3382 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:07.172490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:07.173111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:07.173394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:07.173669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:07.174443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] RBAC: Adding query filter params (role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=640894aa402744af861080d8d0d80f66) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:07.174754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:07.176195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415279da-5f2d-4315-a1d1-bde82fe5a579 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:07.182678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 558/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:07 2022] GET /identity/v3/role_assignments?user.id=640894aa402744af861080d8d0d80f66&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=cee75ad79d9a4ecbbec3a84d69b0c0ec => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:41:08.993078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93a-5c52-49b6-b892-0e9ad2ff9646 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:08.993573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93a-5c52-49b6-b892-0e9ad2ff9646 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:08.993573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93a-5c52-49b6-b892-0e9ad2ff9646 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:08.994926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 549/1107] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:09.000689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.001109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.001243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.019682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:09.020870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:09.084310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 559/1108] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:09.354202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16e93a-5c52-49b6-b892-0e9ad2ff9646 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.384881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:09.453963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16e93a-5c52-49b6-b892-0e9ad2ff9646 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.487970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.488615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.488895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.489166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.491677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.492682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826451f-001a-4fe8-b38a-5c52c5d590b2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.494312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 550/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:09.500089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:09.508060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:09.595773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a150b0c-2dce-4cf8-ac23-cddc06e1d035 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:09.629539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:09.630100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:09.630380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:09.630649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:09.631277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:09.632680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6c2d6-b36b-4efd-8f8a-6d79be9cd79b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:09.652926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 560/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:41:09 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:11.592135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598afb-9f9d-4533-b742-84afc12d45b1 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.593098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598afb-9f9d-4533-b742-84afc12d45b1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.593224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598afb-9f9d-4533-b742-84afc12d45b1 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.594603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 551/1111] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:11.600151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:11.600539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:11.600691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:11.618095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:11.619255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:11.672874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:11.683711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 561/1112] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:41:11.948911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598afb-9f9d-4533-b742-84afc12d45b1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.043278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:12.048981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598afb-9f9d-4533-b742-84afc12d45b1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.082483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.083102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.083385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.083660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] PATH_INFO: `/v3/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.085170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] RBAC: Authorizing `identity:get_role(role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.086554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.087863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 552/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:11 2022] GET /identity/v3/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:12.093787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.189017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234c18-1281-4ace-bcf4-cceeb8d1782a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.221167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.221725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.222043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.222321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] PATH_INFO: `/v3/users/0698f59816c747d9ae54c01b6df3eaa0` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.235477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] RBAC: Authorizing `identity:get_user(user_id=0698f59816c747d9ae54c01b6df3eaa0)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.236914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.238517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 562/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/users/0698f59816c747d9ae54c01b6df3eaa0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:12.244178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.339072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085d1a-7278-45a6-a206-dad9d837a5b7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.371603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.372192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.372475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.372749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.405002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:12.439059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.440478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.535367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 553/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:12.541307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.598578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:12.646383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c894-055e-490c-bd5b-bd53a44fb2eb None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.678260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.678878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.679164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.679441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.680542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.681990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766ed0-53c8-49fe-a215-1b9ecf6550c6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.683593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 563/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:12.690284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:12.753571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:12.787210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d395e5-b5ce-42e3-81b3-f24d13050931 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:12.819963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:12.820555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:12.820837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:12.821110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:12.821847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=89acb3eb235a4ceea8136ed3baedfe19, user.id=0698f59816c747d9ae54c01b6df3eaa0) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:12.822158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:12.823575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072f97f-1e23-4fe7-b4ff-a570d93e8e12 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:12.828691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 554/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:12 2022] GET /identity/v3/role_assignments?user.id=0698f59816c747d9ae54c01b6df3eaa0&scope.project.id=89acb3eb235a4ceea8136ed3baedfe19&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:14.673742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335bff-6d1a-4ef6-938f-f923035beb15 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:14.674286 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335bff-6d1a-4ef6-938f-f923035beb15 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:14.674397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335bff-6d1a-4ef6-938f-f923035beb15 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:14.675663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 564/1118] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:14.681034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:14.681438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:14.682382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:14.700194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:14.701945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:14.770261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 555/1119] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:15.038210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335bff-6d1a-4ef6-938f-f923035beb15 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:15.136528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335bff-6d1a-4ef6-938f-f923035beb15 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:15.152961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:15.169670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:15.170823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.171106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.171383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] PATH_INFO: `/v3/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.172761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] RBAC: Authorizing `identity:get_role(role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:15.174170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:15.175472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 565/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:15 2022] GET /identity/v3/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:15.181230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:15.237746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:15.276732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb7fc-e65e-4dda-93d0-4337b0390193 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:15.308967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:15.309533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.309834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.310109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] PATH_INFO: `/v3/users/0698f59816c747d9ae54c01b6df3eaa0` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.311719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] RBAC: Authorizing `identity:get_user(user_id=0698f59816c747d9ae54c01b6df3eaa0)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:15.313136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:15.314732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 556/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:15 2022] GET /identity/v3/users/0698f59816c747d9ae54c01b6df3eaa0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:15.320467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:15.415429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89957251-c9f1-45c7-8a4a-fdc9dcfa31cd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:15.447856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:15.448467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.448750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.449024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.450137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:15.451572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317b26-7cdc-4ad5-af68-9ed6f443e05d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:15.453134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 566/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:15 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:15.458814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:15.556451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7930a7-706b-4b22-b14d-d9d28b981765 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:15.581703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:15.589831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:15.590489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:15.590773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:15.591052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19/users/0698f59816c747d9ae54c01b6df3eaa0/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:15.593698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] RBAC: Authorizing `identity:create_grant(project_id=89acb3eb235a4ceea8136ed3baedfe19, user_id=0698f59816c747d9ae54c01b6df3eaa0, role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:15.595148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a8da-13ee-4c9a-af15-8819b2996008 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:15.607255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 557/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:41:15 2022] PUT /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19/users/0698f59816c747d9ae54c01b6df3eaa0/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:17.461594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b795-4fbb-4380-998f-1ac9f6850e51 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:17.462194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b795-4fbb-4380-998f-1ac9f6850e51 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:17.462194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b795-4fbb-4380-998f-1ac9f6850e51 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:17.463565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 567/1124] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:17.468689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:17.469070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:17.469248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:17.487523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:17.488703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:17.556146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 558/1125] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:17.825346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b795-4fbb-4380-998f-1ac9f6850e51 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:17.881739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:17.925951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b795-4fbb-4380-998f-1ac9f6850e51 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:17.958064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:17.958689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:17.958974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:17.959254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] PATH_INFO: `/v3/roles/e1ba247543794e7fb0cbbdaf415a715a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:17.960719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] RBAC: Authorizing `identity:get_role(role_id=e1ba247543794e7fb0cbbdaf415a715a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:17.962111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:17.963422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 568/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:17 2022] GET /identity/v3/roles/e1ba247543794e7fb0cbbdaf415a715a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:17.969840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:18.066106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8a42b-f5c2-4e43-8b4e-ed29dbdf3e6b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:18.083108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:18.101437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:18.102089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:18.102375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:18.102656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] PATH_INFO: `/v3/users/0698f59816c747d9ae54c01b6df3eaa0` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:18.103775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] RBAC: Authorizing `identity:get_user(user_id=0698f59816c747d9ae54c01b6df3eaa0)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:18.105204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:18.106798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 559/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:17 2022] GET /identity/v3/users/0698f59816c747d9ae54c01b6df3eaa0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:18.112688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:18.208053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889751e-b810-4423-b73e-3d3af94c040f None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:18.230324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:18.241752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:18.242381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:18.242667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:18.242945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:18.306837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:18.308273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:18.401826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 569/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:18.408332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:18.505469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3ab33-025d-495c-ada4-50bdcce01edc None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:18.538795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:18.539423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:18.539709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:18.539989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] PATH_INFO: `/v3/projects/89acb3eb235a4ceea8136ed3baedfe19` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:18.541099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] RBAC: Authorizing `identity:get_project(project_id=89acb3eb235a4ceea8136ed3baedfe19)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:18.542556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0306d5-bef7-455f-aa13-259503436b72 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:18.544156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 560/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:18 2022] GET /identity/v3/projects/89acb3eb235a4ceea8136ed3baedfe19 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:18.550422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:18.574212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:18.648328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fdc-d2f5-444a-b6bc-1d542c71a3ea None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:18.680429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:18.680978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:18.681276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:18.681537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:18.682289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] RBAC: Adding query filter params (role.id=e1ba247543794e7fb0cbbdaf415a715a, scope.project.id=89acb3eb235a4ceea8136ed3baedfe19, user.id=0698f59816c747d9ae54c01b6df3eaa0) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:18.682599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:18.684107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680838ef-cb0c-4c24-bd19-9a1bf7414d84 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:18.690196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 570/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:18 2022] GET /identity/v3/role_assignments?user.id=0698f59816c747d9ae54c01b6df3eaa0&scope.project.id=89acb3eb235a4ceea8136ed3baedfe19&role.id=e1ba247543794e7fb0cbbdaf415a715a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:20.569704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48866f-8c34-4765-876e-494c7c924d50 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:20.570220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48866f-8c34-4765-876e-494c7c924d50 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:20.570318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48866f-8c34-4765-876e-494c7c924d50 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:20.571628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 561/1131] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:20.576935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:20.577371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:20.577479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:20.595076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:20.596242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:20.661260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 571/1132] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:20.929019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48866f-8c34-4765-876e-494c7c924d50 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:20.984053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:21.028455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48866f-8c34-4765-876e-494c7c924d50 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.061928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.062564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.062849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.063127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.064255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.065693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a8d2c-01d7-4523-8811-4615073455cc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.067291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 562/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:21.073085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:21.090283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:21.169341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afe959-d4bb-4ad4-bfe0-468de01b3a9a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:21.202151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:21.202686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:21.202964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:21.203234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:21.203861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:21.205265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782566-bee3-4bb3-a1a6-f917af9669ad None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:21.231133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 572/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:41:21 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:23.135909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c2b5-4a05-4eb9-8656-e80b36d6246a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.136423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c2b5-4a05-4eb9-8656-e80b36d6246a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.136528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c2b5-4a05-4eb9-8656-e80b36d6246a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.137828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 563/1135] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:23.143725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.144114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.144284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.161846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:23.163011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:23.222316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:23.228420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 573/1136] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:23.498319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87c2b5-4a05-4eb9-8656-e80b36d6246a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.595721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87c2b5-4a05-4eb9-8656-e80b36d6246a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.617897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:23.630406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.631041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.631325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.631599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.632690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.634150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900fb99-378f-487b-9aa5-8fddd67bf0dd None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.635725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 564/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:23.641428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:23.737308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1402c0-acf9-473b-88af-91376829c40f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:23.768897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:23.769487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:23.769786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:23.770072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:23.770712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:23.772116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60265294-63e0-4f96-9f39-acb4531fe6f4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:23.792946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 574/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:41:23 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:25.690474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364f19-f5b8-425f-bab5-4793a1783c9e None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:25.691009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364f19-f5b8-425f-bab5-4793a1783c9e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:25.691009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364f19-f5b8-425f-bab5-4793a1783c9e None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:25.692390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 565/1139] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:25.697638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:25.698064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:25.698245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:25.716279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:25.718071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:25.765356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:25.783998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 575/1140] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:26.049339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5364f19-f5b8-425f-bab5-4793a1783c9e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:26.149673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5364f19-f5b8-425f-bab5-4793a1783c9e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:26.184599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:26.186063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:26.186498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:26.186876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:26.198880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:26.204757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:26.205929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:26.206911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 566/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:26.212284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:26.311521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61c6c-2d49-4a4e-bbc3-548b6f010256 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:26.343752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:26.344356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:26.344643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:26.344922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:26.345588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:26.345926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:26.347291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:26.355311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 576/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:26.361548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:26.409716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:26.457951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d60a0-8bc9-43ac-a5b8-f82f5927e67c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:26.490775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:26.491392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:26.491675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:26.491955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] PATH_INFO: `/v3/users/6d5cd2c71f184625902865318ea6076d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:26.504940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] RBAC: Authorizing `identity:get_user(user_id=6d5cd2c71f184625902865318ea6076d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:26.506407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:26.507987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 567/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/users/6d5cd2c71f184625902865318ea6076d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:26.513895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:26.559027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:26.612568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17f76-c80e-4c47-9761-914d4a5634da None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:26.644879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13509d60-213e-4920-a907-e328538fc580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:26.645482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509d60-213e-4920-a907-e328538fc580 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:26.645796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509d60-213e-4920-a907-e328538fc580 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:26.646070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509d60-213e-4920-a907-e328538fc580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:26.712083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13509d60-213e-4920-a907-e328538fc580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:26.713536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13509d60-213e-4920-a907-e328538fc580 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:26.757676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:26.811158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 577/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:26.816661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:26.914601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486096e5-8f38-427a-9b1f-10140dbc0a4a None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:26.923913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:26.948307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:26.948936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:26.949219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:26.949493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] PATH_INFO: `/v3/projects/11f889c24b7449b5a44ddcade8986e79` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:26.950648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] RBAC: Authorizing `identity:get_project(project_id=11f889c24b7449b5a44ddcade8986e79)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:26.952072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5fc96-adbe-4afd-82a1-4f9ceb099638 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:26.953693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 568/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/projects/11f889c24b7449b5a44ddcade8986e79 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:26.959897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13509d60-213e-4920-a907-e328538fc580 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:27.056856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13509d60-213e-4920-a907-e328538fc580 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:27.090535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:27.091142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:27.091981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:27.092256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:27.092990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=11f889c24b7449b5a44ddcade8986e79, user.id=6d5cd2c71f184625902865318ea6076d) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:27.093303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:27.094751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefee45-2ef9-412e-8f8a-8efb9edcdc70 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:27.100225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 578/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:26 2022] GET /identity/v3/role_assignments?user.id=6d5cd2c71f184625902865318ea6076d&scope.project.id=11f889c24b7449b5a44ddcade8986e79&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:28.948535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd2ea-0f77-4097-826b-c214e15ae5c6 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:28.949055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd2ea-0f77-4097-826b-c214e15ae5c6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:28.949055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd2ea-0f77-4097-826b-c214e15ae5c6 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:28.950392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 569/1147] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:28.955909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:28.956346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:28.956474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:28.974248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:28.975424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:28.978110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:29.039617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 579/1148] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:29.304626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fd2ea-0f77-4097-826b-c214e15ae5c6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:29.402924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fd2ea-0f77-4097-826b-c214e15ae5c6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:29.435926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:29.436539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:29.436818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:29.437085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:29.446810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:29.451420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:29.452466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:29.453380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 570/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:29.458598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:29.552339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566b0f6-14aa-43e2-ae17-bdb12fda810c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:29.585426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:29.586007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:29.586294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:29.586571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:29.587236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:29.587541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:29.588896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:29.596584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 580/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:29.602612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:29.637056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:29.699544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afe9af-b37b-4c2c-9ded-5f5168ac9d19 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:29.735202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:29.735821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:29.736103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:29.736374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] PATH_INFO: `/v3/users/6d5cd2c71f184625902865318ea6076d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:29.737473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] RBAC: Authorizing `identity:get_user(user_id=6d5cd2c71f184625902865318ea6076d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:29.738921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:29.740478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 571/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:29 2022] GET /identity/v3/users/6d5cd2c71f184625902865318ea6076d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:29.746348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:29.749149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:29.842192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36013f-0232-4127-a7b3-5be85978c025 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:29.875080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:29.875707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:29.875993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:29.876272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] PATH_INFO: `/v3/projects/11f889c24b7449b5a44ddcade8986e79` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:29.877379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] RBAC: Authorizing `identity:get_project(project_id=11f889c24b7449b5a44ddcade8986e79)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:29.878848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6af31-6974-46a6-bad6-39f6654d569c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:29.880448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 581/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:29 2022] GET /identity/v3/projects/11f889c24b7449b5a44ddcade8986e79 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:29.886410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:29.981219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8af-3f18-43c0-aba3-aef01982d120 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:29.983501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:30.015153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:30.015809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:30.016094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:30.016370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] PATH_INFO: `/v3/projects/11f889c24b7449b5a44ddcade8986e79/users/6d5cd2c71f184625902865318ea6076d/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:30.018319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f889c24b7449b5a44ddcade8986e79, user_id=6d5cd2c71f184625902865318ea6076d, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:30.019748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3541d-9aa0-4031-ae1d-eaacca556b05 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:30.032778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 572/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:41:29 2022] PUT /identity/v3/projects/11f889c24b7449b5a44ddcade8986e79/users/6d5cd2c71f184625902865318ea6076d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:31.920140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e134-b92c-4909-a7e4-45ad2f54a205 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:31.920631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e134-b92c-4909-a7e4-45ad2f54a205 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:31.920631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e134-b92c-4909-a7e4-45ad2f54a205 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:31.921981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 582/1154] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:31.927688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:31.928098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:31.928241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:31.945589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:31.946790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:32.011053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 573/1155] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:32.274020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82e134-b92c-4909-a7e4-45ad2f54a205 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:32.342163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:32.373241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82e134-b92c-4909-a7e4-45ad2f54a205 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:32.405595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.406240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.406525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.406804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.417535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:32.422686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:32.423749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:32.424882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 583/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:32.429656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:32.518935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:32.526226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d7985-e41d-4da3-a90d-8f02b319f3d3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:32.559575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.560758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.561039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.561309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.561999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:32.562302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:32.563658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:32.571643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 574/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:32.577341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:32.673529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c784-b2b3-41da-94ab-141508a4be3c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:32.700249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:32.705893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.706508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.706788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.707060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] PATH_INFO: `/v3/users/6d5cd2c71f184625902865318ea6076d` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.708154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] RBAC: Authorizing `identity:get_user(user_id=6d5cd2c71f184625902865318ea6076d)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:32.709576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:32.711155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 584/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:32 2022] GET /identity/v3/users/6d5cd2c71f184625902865318ea6076d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:32.717446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:32.812957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c39-d0c5-40e1-9477-dfae51d0cd5d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:32.844683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:32.845277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:32.845560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:32.845864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:32.869644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:32.910837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:32.912268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:33.006330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 575/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:33.012429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:33.108466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58a94-688a-48b4-8525-6fe3068bf032 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:33.141715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:33.142375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:33.142660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:33.142936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] PATH_INFO: `/v3/projects/11f889c24b7449b5a44ddcade8986e79` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:33.144037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] RBAC: Authorizing `identity:get_project(project_id=11f889c24b7449b5a44ddcade8986e79)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:33.145457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c4265-b0a3-4c69-8e80-a78028900d0e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:33.147089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 585/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:33 2022] GET /identity/v3/projects/11f889c24b7449b5a44ddcade8986e79 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:33.153259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:33.207512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:33.249675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7bf41-d09c-4366-a262-558f0b59a135 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:33.282352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:33.282939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:33.283218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:33.283487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:33.284198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=11f889c24b7449b5a44ddcade8986e79, user.id=6d5cd2c71f184625902865318ea6076d) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:33.284504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:33.285942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdc2b-520b-4cb1-b1ee-e3d7500881c6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:33.291583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 576/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:33 2022] GET /identity/v3/role_assignments?user.id=6d5cd2c71f184625902865318ea6076d&scope.project.id=11f889c24b7449b5a44ddcade8986e79&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:35.177710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a995df-c61f-483c-9aa8-d0d3748cf901 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.178256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a995df-c61f-483c-9aa8-d0d3748cf901 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.178369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a995df-c61f-483c-9aa8-d0d3748cf901 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.179617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 586/1162] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:35.184689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.185095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.185280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.202634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:35.203807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:35.267936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 577/1163] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:35.530216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a995df-c61f-483c-9aa8-d0d3748cf901 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.595413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:35.629729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a995df-c61f-483c-9aa8-d0d3748cf901 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.661667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.662290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.662573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.662847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.726226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:35.727654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.786933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:35.822116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 587/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:41:35.828736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:35.876501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:35.923992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc276b-fde4-4bd0-98cd-305281d97bd1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:35.957809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:35.958460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:35.958711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:35.958990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:35.965359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:35.966834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c198b177-e47f-4d8b-93f5-21ca3f1241df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:35.977939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:35.979138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:35.980154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 578/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:35.984894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:36.079561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae0c6b-86a9-47be-bf35-f91f209618f1 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:36.112065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:36.112651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:36.112931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:36.113205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:36.113875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:36.114178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:36.115519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905e87f-3ada-4dc2-9ca5-ee6a3976e001 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:36.122814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 588/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Wed Aug 24 05:41:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:37.967420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e060-43f2-4067-8f89-fe447b8a3e66 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:37.967933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e060-43f2-4067-8f89-fe447b8a3e66 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:37.967933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e060-43f2-4067-8f89-fe447b8a3e66 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:37.969249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 579/1167] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:37.974656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea483-5674-4d0a-8f1b-e3079e16b66a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:37.975063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea483-5674-4d0a-8f1b-e3079e16b66a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:37.975210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea483-5674-4d0a-8f1b-e3079e16b66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:37.993967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-49fea483-5674-4d0a-8f1b-e3079e16b66a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:37.995134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-49fea483-5674-4d0a-8f1b-e3079e16b66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:38.017372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:38.059117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 589/1168] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:38.324104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e060-43f2-4067-8f89-fe447b8a3e66 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:38.422537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e060-43f2-4067-8f89-fe447b8a3e66 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:38.432455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:38.455799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:38.456394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:38.456681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:38.456961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:38.457636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:38.459102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d96595-0bdc-4106-81b3-7287d0e87020 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:38.474227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 580/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Wed Aug 24 05:41:38 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:40.408885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745528a-9187-4219-b8fa-9503b41271f2 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.409408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745528a-9187-4219-b8fa-9503b41271f2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.409500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745528a-9187-4219-b8fa-9503b41271f2 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.410820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 590/1170] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:40.416201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.416605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.416757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.435541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:40.436722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:40.501499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 581/1171] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:40.763925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745528a-9187-4219-b8fa-9503b41271f2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:40.859984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745528a-9187-4219-b8fa-9503b41271f2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:40.893571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:40.894221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:40.894504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:40.894778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] PATH_INFO: `/v3/domains/1e582e1b342247ac80d7fc7162c1808a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:40.905360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e582e1b342247ac80d7fc7162c1808a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:40.906813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cfcf6-03ab-409e-bb56-03d22954f0f9 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:40.908361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 591/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Wed Aug 24 05:41:40 2022] GET /identity/v3/domains/1e582e1b342247ac80d7fc7162c1808a => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:40.914083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:41.008270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:41.011450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1de1-51ca-4333-b4e6-21d0ad736ad2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:41.047472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:41.048006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:41.048289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:41.048561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:41.049238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:41.050719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f5378-11f4-4778-8f6e-5c93503bb073 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:41.076513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 582/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:41:40 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:42.957116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c7db-269b-4897-b573-0b9ee34511d6 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:42.957630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c7db-269b-4897-b573-0b9ee34511d6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:42.957630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c7db-269b-4897-b573-0b9ee34511d6 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:42.958949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 592/1174] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:42.964351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:42.964713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:42.964913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:42.983521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:42.984707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:43.049952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 583/1175] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:43.320740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04c7db-269b-4897-b573-0b9ee34511d6 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.342948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:43.419321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04c7db-269b-4897-b573-0b9ee34511d6 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:43.451658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:43.452279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.452565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.452841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] PATH_INFO: `/v3/domains/1e582e1b342247ac80d7fc7162c1808a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.453971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e582e1b342247ac80d7fc7162c1808a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:43.455396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465e130-d76a-4489-b9d8-f9ce3e87b611 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:43.456932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 593/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Wed Aug 24 05:41:43 2022] GET /identity/v3/domains/1e582e1b342247ac80d7fc7162c1808a => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:43.462526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:43.539907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:43.559190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dd24f-3288-412d-a26b-04a8693eb63c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:43.592369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:43.592916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:43.593199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:43.593482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:43.594174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:43.595602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f38ef7-c1f1-467f-a718-e6fd4b22c2b2 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:43.616514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 584/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:41:43 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:41:45.515902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da07f-ffec-44b3-9480-78745bc874cf None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:45.516473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da07f-ffec-44b3-9480-78745bc874cf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:45.516473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da07f-ffec-44b3-9480-78745bc874cf None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:45.517818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 594/1178] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:45.523145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:45.523507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:45.523695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:45.541257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:45.542458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:45.606818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 585/1179] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:45.876408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48da07f-ffec-44b3-9480-78745bc874cf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:45.963038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:45.976372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48da07f-ffec-44b3-9480-78745bc874cf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.009276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.009929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.010216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.010492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.021151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:46.025782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:46.026844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:46.027945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 595/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:46.033530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.097320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.130006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c39f5-cff4-4228-9de2-d8e741e66820 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.162846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.163449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.163732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.164003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.164660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:46.164960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.166355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.174635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 586/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:46.180362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.274800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8172e7f-11aa-40e8-acdd-745c1385ff84 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.307016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.307626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.307907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.308180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] PATH_INFO: `/v3/users/af8cba4da1f4433ca80522368a678748` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.320543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=af8cba4da1f4433ca80522368a678748)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.321988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.323538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 596/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:46 2022] GET /identity/v3/users/af8cba4da1f4433ca80522368a678748 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:46.329272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.429177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ab269-71f7-4aa1-88a6-62a2101297a7 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.455759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.461716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.462339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.462622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.462897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.528736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.530197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.625238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 587/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:41:46.631170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.640312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.729692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d7eb-bdff-491f-8e3f-190fb3c17bb4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.762732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.763350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.763632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.763910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] PATH_INFO: `/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.765012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] RBAC: Authorizing `identity:get_project(project_id=6ee4b85ac06d4bd79d74b974f5b5343a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.766480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82768-a1ae-43e2-abd6-f43e9c3be888 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.768071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 597/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:46 2022] GET /identity/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:46.774091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:46.802984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:46.870369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa7a5-2dcd-457c-bcbe-39d193157061 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:46.903575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:46.904170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:46.904455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:46.904732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:46.905451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=6ee4b85ac06d4bd79d74b974f5b5343a, user.id=af8cba4da1f4433ca80522368a678748) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:46.905776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:46.907210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b24ff-8236-46f9-bdb0-dee57276ec28 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:46.912416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 588/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:46 2022] GET /identity/v3/role_assignments?user.id=af8cba4da1f4433ca80522368a678748&scope.project.id=6ee4b85ac06d4bd79d74b974f5b5343a&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:48.767056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6822b3-0438-4f05-bb66-c38005683046 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:48.767587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6822b3-0438-4f05-bb66-c38005683046 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:48.767587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6822b3-0438-4f05-bb66-c38005683046 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.768935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 598/1186] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:48.774118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:48.774536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:48.774677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:48.792167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:48.793862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:48.857888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 589/1187] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:41:49.127562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6822b3-0438-4f05-bb66-c38005683046 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.200026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:49.225771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6822b3-0438-4f05-bb66-c38005683046 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.258219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.258846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.259131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.259410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.269061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:49.273657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:49.274802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:41:49.276028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 599/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:49.281246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.306020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:49.378721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7667220-cf93-4b85-9484-0947cf68cd4e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.411493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.412102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.412390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.412670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.413341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:49.413652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.415051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.423401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 590/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:49.429055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.525808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a76eed-8b7d-487b-b920-5497e869516d None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.558735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.560002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.560342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.560620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] PATH_INFO: `/v3/users/af8cba4da1f4433ca80522368a678748` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.561831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] RBAC: Authorizing `identity:get_user(user_id=af8cba4da1f4433ca80522368a678748)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.563264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.564826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 600/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/users/af8cba4da1f4433ca80522368a678748 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:49.570520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.653152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:49.667887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd40140-ebb8-459e-b469-6be46ed59f7b None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.700799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.701417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.701701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.702004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] PATH_INFO: `/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.703100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] RBAC: Authorizing `identity:get_project(project_id=6ee4b85ac06d4bd79d74b974f5b5343a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.704521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52749a-e809-4035-9b60-58c18b9546fc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.706161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 591/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:49 2022] GET /identity/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:49.712302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:49.715181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:49.811861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea2f7-fdfc-435f-8787-b088462b40c7 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:49.844313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:49.844961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:49.845248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:49.845526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] PATH_INFO: `/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a/users/af8cba4da1f4433ca80522368a678748/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:49.847709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ee4b85ac06d4bd79d74b974f5b5343a, user_id=af8cba4da1f4433ca80522368a678748, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:49.849203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcc621-28a4-4ad9-958a-727fb1aac456 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:49.861687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 601/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:41:49 2022] PUT /identity/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a/users/af8cba4da1f4433ca80522368a678748/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:41:51.719744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829071-6795-474a-88e1-ffdd6d9e4518 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.720281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829071-6795-474a-88e1-ffdd6d9e4518 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.720281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829071-6795-474a-88e1-ffdd6d9e4518 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.721908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 592/1193] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:41:51.727228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:51.727641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:51.727786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:51.745272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:51.747010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:51.800826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:51.812335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 602/1194] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:41:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:41:52.074913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829071-6795-474a-88e1-ffdd6d9e4518 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.173506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829071-6795-474a-88e1-ffdd6d9e4518 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.205133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.205755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.206067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.206346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.218511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:41:52.223410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:41:52.224495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:41:52.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 593/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:41:52.230468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.324271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5c29c-7bbe-4e7a-9ac7-7ab5184dfc00 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.357689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.358253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.358537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.358808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.359458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:52.359757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.361102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.368669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 603/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:52.374347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.389925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.470551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf2e0-a224-4534-b741-08be859fe498 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.502720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.503336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.503620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.503894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] PATH_INFO: `/v3/users/af8cba4da1f4433ca80522368a678748` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.505001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] RBAC: Authorizing `identity:get_user(user_id=af8cba4da1f4433ca80522368a678748)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.506451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.507995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 594/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/users/af8cba4da1f4433ca80522368a678748 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:52.514405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.570119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.614569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd342d-b852-4a27-b3af-50467c6f02a6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.646650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.647247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.647531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.647805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.712191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.713662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.764685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.807765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 604/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:41:52.814249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:52.892929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.910671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44385b-1a2e-4a9f-83e7-ef1519213336 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:52.942506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:52.943120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:52.943402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:52.943680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] PATH_INFO: `/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:52.944766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ee4b85ac06d4bd79d74b974f5b5343a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:52.946211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba89d-e7f0-43c6-995d-d406df9f2cd6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:52.947802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 595/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/projects/6ee4b85ac06d4bd79d74b974f5b5343a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:41:52.953752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:53.049712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c83f1-2667-4074-bfda-8a715694a7c4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:53.083722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:53.084325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:53.084609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:53.084914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:53.085641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=6ee4b85ac06d4bd79d74b974f5b5343a, user.id=af8cba4da1f4433ca80522368a678748) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:41:53.085985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:53.087420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64976e-4df3-4c23-adf2-9604bd821aa8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:53.093051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 605/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:41:52 2022] GET /identity/v3/role_assignments?user.id=af8cba4da1f4433ca80522368a678748&scope.project.id=6ee4b85ac06d4bd79d74b974f5b5343a&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:02.938613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=25 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:03.090461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:48.121716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebae3b-9d24-4c2c-80e3-7db471e54346 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:48.122369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebae3b-9d24-4c2c-80e3-7db471e54346 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:48.122369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebae3b-9d24-4c2c-80e3-7db471e54346 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:48.123596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 596/1201] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:48.129706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:48.130624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:48.131095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:48.152072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:48.153779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:48.241949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 606/1202] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:42:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:42:48.557782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebae3b-9d24-4c2c-80e3-7db471e54346 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:48.703224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebae3b-9d24-4c2c-80e3-7db471e54346 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:48.743145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:48.744335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:48.744618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:48.744891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:48.758867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:48.758867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:42:48.774105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:48.775756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:42:48.776948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:42:48.776948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:48.776948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:42:48.776948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 597/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:48.781401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:48.910182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648ac24-920b-4b19-ac57-4a5f168db7b3 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:48.943862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:48.954507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:48.955095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:48.955382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:48.955660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:48.956309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:48.956614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:48.958075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff23fc-b3de-4fa4-acc5-c0b29a882c08 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:48.970871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 607/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:48.976546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:49.043742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:49.101623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2041ae1-9c46-47f9-884e-11f353277386 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:49.146620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:49.147277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:49.147511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:49.147786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:49.148438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:49.150450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e90e1e-50cc-4439-9328-1f054a593a1d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:49.177616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 598/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Wed Aug 24 05:42:48 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:42:51.364977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973b5b-4f1d-4b37-927b-2c9e053d9178 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:51.365518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973b5b-4f1d-4b37-927b-2c9e053d9178 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:51.365518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973b5b-4f1d-4b37-927b-2c9e053d9178 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:51.367278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 608/1206] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:51.373357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:51.373864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:51.373998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:51.394417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:51.395758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:51.471109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 599/1207] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:42:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:42:51.755624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973b5b-4f1d-4b37-927b-2c9e053d9178 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:51.893658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973b5b-4f1d-4b37-927b-2c9e053d9178 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:51.933470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:51.934133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:51.934418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:51.934695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:51.953859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:42:51.958767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:51.961831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:51.963099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 609/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:51.966421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.009942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:52.077907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9c5c8-3168-48f5-9156-a411228059a0 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:52.115593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:52.116269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:52.116563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:52.116915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:52.117598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:52.118021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.120194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.128913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 600/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:42:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:52.134706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.190472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:52.252544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fb4f-a5bd-4f9b-a6a3-3557411313e9 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:52.287927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:52.288609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:52.288914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:52.289196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:52.301928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.303710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:42:52.319797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:52.321966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:42:52.322924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:42:52.322924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:52.322924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:52.322924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 610/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:52.335087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.440946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:52.443971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be9a5-3aef-4530-9bf6-1fcc0e7bbfcc None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:52.480368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:52.481460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:52.481460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:52.481631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:52.482235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:52.482540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.485629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.496811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 601/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:52.502561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.611063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586acd6-e302-4414-8b3e-711a01375b22 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:52.612588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:52.652664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:52.653808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:52.653808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:52.653998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:52.663216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.664750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:42:52.676603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:52.677882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:52.678978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 611/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:52.684154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.792197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356b14-e37d-41e1-a9d6-929aa0362cdb None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:52.833346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:52.834027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:52.834328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:52.834637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:52.835517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:52.835909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:52.838225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:52.860498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 602/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:42:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:42:52.866798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:52.983236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad7f-b5df-48e7-9fae-8ff79bb0b849 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:53.024818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:53.025482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:53.025781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:53.026134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:53.067266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:53.116332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:53.117705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:53.224321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 612/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:42:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:42:53.230516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:53.251249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:53.339136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b51d87-d5a2-4f17-a49d-046a5966644f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:53.379419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:53.380147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:53.380529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:53.380907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:53.392417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:53.393943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:42:53.410485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:53.411832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:42:53.412888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:42:53.412888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:53.412888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:42:53.413315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 603/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:42:53.419045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:53.489282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:53.534831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f0d1-daa4-465f-a7a5-fbf2cfa83129 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:53.578096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:53.578726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:53.578998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:53.579321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:53.580062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:53.580375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:53.582053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:53.593946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 613/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:53.599633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:53.681281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:53.722954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf23f9-5163-48b5-9d80-acb01bd59ec3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:53.762928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:53.764040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:53.764431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:53.764970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:53.773253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:53.775267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:42:53.788063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:53.789200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:42:53.790951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 604/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:53.796143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:53.913802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962f68-57cf-4602-81d4-739fb4de53b6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:53.943702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:53.958308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:53.959206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:53.959575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:53.959977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:53.960787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:53.961122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:53.963441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d9425-7fc2-4cf8-87b0-26e2e84b8244 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:53.984390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 614/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:42:53.990215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:54.101512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514ff7-6c1a-4ba4-a959-1ffc824ff630 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:54.135973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:54.143085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:54.143721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:54.144062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:54.144345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:54.145231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=9dccfa8372374f06b49680ed24b3020c) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:54.145550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:54.147063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db230eac-5968-4ab7-9ff3-555f6cbf7da6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:54.154614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 605/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:42:53 2022] GET /identity/v3/role_assignments?user.id=9dccfa8372374f06b49680ed24b3020c&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:56.138764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187249-ce13-4e43-8717-97df4d90abfc None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:56.139317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187249-ce13-4e43-8717-97df4d90abfc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:56.139405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187249-ce13-4e43-8717-97df4d90abfc None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:56.141416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 615/1220] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:42:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:56.146918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:56.147299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:56.147482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:56.169494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:56.170881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:56.253788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 606/1221] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:42:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:42:56.525454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187249-ce13-4e43-8717-97df4d90abfc None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:56.643377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187249-ce13-4e43-8717-97df4d90abfc None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:56.679981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:56.680653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:56.681072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:56.681399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:56.693224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:42:56.699381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:56.700340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:56.701169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 616/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:56.706923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:56.813816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f627f1-628e-4a07-8e79-974706f1f62e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:56.839121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:56.851784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:56.852386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:56.853180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:56.853509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:56.854202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] RBAC: Adding query filter params (name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:56.854507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:56.855870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:56.864624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 607/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:42:56.870926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:56.916698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:56.975315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ec814-081e-4fe7-9cff-8c529917eb05 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.011820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.012482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.012831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.013114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.023061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.025148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:42:57.042204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:57.048198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:42:57.049357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:42:57.049357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:57.049357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:57.049357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 617/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:57.050763 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.163083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0d00-69e0-488b-be39-a872ec961989 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.198475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.199102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.199445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.199726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.200404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:57.200714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.202126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.214452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 608/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:57.220598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.320242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:57.329836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459403-4a4b-4524-94c3-43fef427ce30 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.370133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.370879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.371258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.371572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.379322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.380800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:42:57.392276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:57.393447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:57.394586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 618/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:57.399647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.450551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:57.509992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f9e4-fda1-40a7-b06c-a15e8e67cce8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.546824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.547436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.547717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.547993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.548728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:57.549111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.551975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.573689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 609/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:57.579611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.705808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9ad1-789a-46da-815d-ea39395014e2 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.748545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.749187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.749525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.749738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.762519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.764024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:42:57.779089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:57.780238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:42:57.781564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:42:57.781564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:42:57.781564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:57.781564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 619/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:42:57.786208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.901978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f466-064f-40fd-a622-13b92e0d7599 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:57.904568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:57.940585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:57.941199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:57.941480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:57.941752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:57.942465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:57.942767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:57.944123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:57.961366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 610/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:57.963082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:57.973796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:58.078953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9f93-c0d8-490c-91bf-2185632503c6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:58.116851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:58.117529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:58.117949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:58.118795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:58.126038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:58.127474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:42:58.138741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:42:58.139901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:42:58.141123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 620/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:42:58.146337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:58.255578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc3edd-4c45-4233-962e-30aa881de763 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:58.294366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:58.295054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:58.295381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:58.295704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:58.296474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:58.296784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:58.298234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97da2e6-337e-4152-b782-b4bba84073ed None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:58.311034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 611/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:58.317075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:58.389468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:58.428660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaecc7-46c3-4004-a7f5-274d33be1c7a None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:58.466626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:58.467352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:58.467636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:58.467915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/9dccfa8372374f06b49680ed24b3020c/roles/557e0146bea5471a8222944fdf828bff` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:58.483756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=9dccfa8372374f06b49680ed24b3020c, role_id=557e0146bea5471a8222944fdf828bff)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:58.485221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6270d-ec00-4d85-95f3-30efaee71e49 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:58.497477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 621/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:42:58 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/9dccfa8372374f06b49680ed24b3020c/roles/557e0146bea5471a8222944fdf828bff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:43:00.489272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66d9f-1747-446a-bf5b-517f1cae16b3 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:00.489828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66d9f-1747-446a-bf5b-517f1cae16b3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:00.490001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66d9f-1747-446a-bf5b-517f1cae16b3 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:00.491515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 612/1233] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:00.497229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:00.497661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:00.497917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:00.516832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:00.518045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:00.588567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 622/1234] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:00.872662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc66d9f-1747-446a-bf5b-517f1cae16b3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:00.901495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:00.990484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc66d9f-1747-446a-bf5b-517f1cae16b3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.026234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.027012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.027381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.027738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.040097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:43:01.045059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:01.046207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:01.047408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 613/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Wed Aug 24 05:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:01.052417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.104796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:01.167609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c8ba8-9e74-48f4-8a8a-fa9d7da6b4fe None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.206919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.207542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.207827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.208102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.208775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] RBAC: Adding query filter params (name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:01.209080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:01.210526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:01.220331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 623/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:01.227589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.324947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:01.341863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745285f-48d4-4b3e-9f7d-5608899b615d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.379439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.380335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.380662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.380942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.394291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:01.395736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:01.413557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:01.414840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:01.416030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:01.416030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:01.416030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:01.416030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 614/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:01.421233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.535211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ed763-5fcd-4e43-81c4-463bf4144089 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.545202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:01.574145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.574882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.575357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.575647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.576344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:01.576705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:01.578441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:01.591269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 624/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:01.598246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.707769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b58d7-e167-42fa-9543-f5724fd4d823 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.744375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.744995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.745298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.745545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.748318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:01.753559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:01.755418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:43:01.766668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:01.767805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:01.768919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 615/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:01.773752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:01.883271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d2d4-f3df-4b91-8a75-acc087538b6b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:01.920087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:01.920698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:01.920981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:01.921256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:01.922030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:01.922335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:01.923760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:01.941463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 625/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:01.947454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.056091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f508-62e7-4f8d-ad22-d105ed6fb236 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.096762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.097527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.097957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.098228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.162989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:02.170800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.172390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.282241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 616/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:43:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:43:02.288196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.315976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:02.398062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493e60-bbb3-47aa-a95a-37768487f273 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.434201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.434843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.435127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.435405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.445351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.447359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:02.462504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:02.463456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:02.464485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:02.464485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:02.464485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:02.465928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 626/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:02.469587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.570474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:02.577067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925d83e-608e-4dd4-8c20-1cd5482ea317 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.612933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.613669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.613848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.614134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.614782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:02.615088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.616455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.628664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 617/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:02.634482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.726011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:02.754488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991013d-11c5-45e1-ba17-6f2de119a678 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.790225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.790872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.791150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.791421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.798131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.799538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:43:02.810487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:02.811566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:02.817427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 627/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:02.818048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:02.932018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098a52-0599-4cd5-aa73-dee581f6f81c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:02.971018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:02.971630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:02.971920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:02.972198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:02.972902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:02.973285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:02.975078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a0800-59fb-42bc-8bd5-b129230efb17 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:02.988244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 618/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:43:02.994612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:03.112242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad2e4-6eae-464f-b758-c32b979d47c4 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:03.148356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:03.151183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:03.151487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:03.151763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:03.152506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] RBAC: Adding query filter params (role.id=557e0146bea5471a8222944fdf828bff, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=9dccfa8372374f06b49680ed24b3020c) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:03.152813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:03.154438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b43f-95df-4e10-8190-0c84b9a00ff5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:03.160886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 628/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:43:02 2022] GET /identity/v3/role_assignments?user.id=9dccfa8372374f06b49680ed24b3020c&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=557e0146bea5471a8222944fdf828bff => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:05.188230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9679-5ac1-4db8-9175-0521f4d7637b None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:05.188815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9679-5ac1-4db8-9175-0521f4d7637b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:05.188815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb9679-5ac1-4db8-9175-0521f4d7637b None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:05.190215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 619/1247] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:05.195674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:05.196651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:05.196763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:05.203140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:05.216550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:05.217799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:05.293829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 629/1248] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:05.569377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9679-5ac1-4db8-9175-0521f4d7637b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:05.590421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:05.688088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb9679-5ac1-4db8-9175-0521f4d7637b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:05.735073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:05.735907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:05.736306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:05.736611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:05.750438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:43:05.757014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:05.758824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:05.759654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 620/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:05.765969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:05.881690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe06ca-e8a3-4b9a-8ad7-eec8926d0bce None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:05.916673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:05.922070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:05.922686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:05.922973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:05.923254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:05.923926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:05.924236 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:05.925609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:05.934539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 630/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:05.941008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:06.029693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:06.057785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74331d-bcf8-40c7-bc7d-f23fddbed34e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:06.094749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:06.095474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:06.095760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:06.096036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:06.106304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:06.107731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:06.122536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:06.123681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:06.129645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:06.129645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:06.129645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:06.129645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 621/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:06.129951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:06.245800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b97df-d52e-47ba-9db4-b1d2981d0594 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:06.282768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:06.283459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:06.283766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:06.284047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:06.284666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:06.285006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:06.286646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:06.303953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 631/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:43:06.305287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:06.422884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eba4d-68f5-454a-93ba-75a1d70c982e None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:06.452549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:06.461612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:06.462291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:06.462633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:06.462941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:06.471184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:06.472782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:43:06.484795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:06.490874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:06.492195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 622/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:43:06.494649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:06.553953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:06.607020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9172cd-19ca-47be-8403-3de410d49235 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:06.647838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:06.648580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:06.648906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:06.649179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:06.650107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:06.650422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:06.652385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:06.672665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 632/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:43:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:06.678911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:06.806820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2434-4eab-4f99-8f74-509b4f251862 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:06.847551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:06.848301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:06.848595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:06.848903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:06.916483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:06.932272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:06.933741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.046215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 623/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:43:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:43:07.047407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.152621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcc8e4-128a-4eaa-bbe0-445fc76ed497 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.167986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:07.194033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.194677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.194986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.195241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.206630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.208081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:07.225343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:07.226370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:07.227976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:07.227976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:07.227976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:07.227976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 633/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:07.234470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.332684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:07.347519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff187-50db-474a-b3e4-73806935a143 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.385374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.386043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.386384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.386686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.387416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:07.387861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.389375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.402555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 624/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:43:07.408802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.520435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a073ac-9665-4ed0-94be-87f4c2f0cf68 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.577393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.578093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.578384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.578667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.587031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.588532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:43:07.601034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:07.602308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:07.603411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 634/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:07.608442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.721017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b100842-3da2-4a3b-acc1-95862f05b639 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.764082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.764709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.765075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.765353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.766100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:07.766411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.767861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b44072-3fc6-4798-9941-15b968e55aa0 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.781533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 625/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:07.789060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:07.815529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:07.898608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412a7b-531c-4a48-a956-9541a53e2390 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:07.933976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:07.934595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:07.934881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:07.935162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:07.935905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=9dccfa8372374f06b49680ed24b3020c) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:07.936219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:07.937663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179f85d-6fee-4c7c-b928-98e74416bfbf None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:07.953816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 635/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:43:07 2022] GET /identity/v3/role_assignments?user.id=9dccfa8372374f06b49680ed24b3020c&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:43:09.814957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b70b1-2d10-46da-8870-355ae11cea8c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:09.815451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b70b1-2d10-46da-8870-355ae11cea8c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:09.815451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b70b1-2d10-46da-8870-355ae11cea8c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:09.816756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 626/1261] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:09.822068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:09.822457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:09.822629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:09.840831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:09.842059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:09.906035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 636/1262] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:10.167977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b70b1-2d10-46da-8870-355ae11cea8c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:10.178715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:10.267510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b70b1-2d10-46da-8870-355ae11cea8c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:10.301342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:10.301992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.302274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.302549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.312389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:43:10.317129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:10.318328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:10.319527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 627/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:10.324247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:10.342313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:10.420691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb45ea-d188-4f6d-9a2a-e754399536f4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:10.452321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:10.452908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.453188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.453459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.454140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:10.454441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:10.455788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:10.463935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 637/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:10.469879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:10.534874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:10.566367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f05eb-ced9-48eb-a20b-a2184bb1ba00 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:10.599732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:10.600347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.600628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.600897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.610398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:10.611819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:10.625596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:10.626577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:10.627529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:10.627529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:10.627529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:10.627529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 628/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:43:10.632413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:10.718011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:10.742708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d60c3-80db-4087-bad1-5c54792ddd90 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:10.778947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:10.779547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.779830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.780103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.780740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:10.781044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:10.782424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:10.793698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 638/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:10.799410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:10.897716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0434-1261-4a0a-8dff-9e59ff1a9b1c None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:10.916526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:10.930731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:10.931348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:10.931631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:10.931905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] PATH_INFO: `/v3/users/placement` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:10.939030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:10.940454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:43:10.951709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:10.952792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:10.953715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 629/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:10.958646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.053318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92088df-4966-4566-ba08-61bd596415f5 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.086314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.086910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.087195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.087472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.088193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:11.088499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.089944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.098462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:11.107013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 639/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:43:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:11.112592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.209832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f688833-4827-4eea-aae0-d75cf56b976d None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.242708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.243337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.243621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.243900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.254086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.255506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:11.269750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:11.270869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:11.271923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:11.271923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:11.271923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:11.271923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 630/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:11.276788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.372445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fa0ac-0ed3-4930-a5fb-2a40843ec88e None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.404878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.405467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.405748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.406050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.406682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:11.406980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.408326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.419432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 640/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:11.425606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.457185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:11.524724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40742-7daf-456e-8cbf-40588b1ecdba None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.558723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.559360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.559652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.559932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.566860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.568309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:43:11.580300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:11.581313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:11.582416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 631/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:11.587154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.643713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:11.684853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e661-4009-4f04-8924-88896dd5a7c6 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.720366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.720970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.721256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.721533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.722255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:11.722567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.723996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29f2e-cda8-426a-bae3-29ad36aeb3de None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.736401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 641/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:11.742463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:11.830367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:11.839540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af611-8665-4ec8-8f82-e9885fc46f9f None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:11.872939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:11.873588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:11.873904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:11.874183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] PATH_INFO: `/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/9dccfa8372374f06b49680ed24b3020c/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:11.876038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] RBAC: Authorizing `identity:create_grant(project_id=41615b72a6f64c26851c96fec81cc2a7, user_id=9dccfa8372374f06b49680ed24b3020c, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:11.877469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2d614-de32-466f-a81a-4a69c8ebc7ba None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:11.889499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 632/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Wed Aug 24 05:43:11 2022] PUT /identity/v3/projects/41615b72a6f64c26851c96fec81cc2a7/users/9dccfa8372374f06b49680ed24b3020c/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:43:13.747053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd447-7892-4eb2-a558-b1f88a22df1e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:13.747567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd447-7892-4eb2-a558-b1f88a22df1e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:13.747687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd447-7892-4eb2-a558-b1f88a22df1e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:13.748945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 642/1274] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:13.754232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:13.754635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:13.754795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:13.772326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:13.773526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:13.837789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 633/1275] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:14.103997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd447-7892-4eb2-a558-b1f88a22df1e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.200249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd447-7892-4eb2-a558-b1f88a22df1e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:14.217238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:14.234519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:14.235135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:14.235415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:14.235685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:14.245271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:43:14.249851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:14.250924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:14.251971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 643/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:14.259473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.337403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:14.355936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70fee3-842a-4880-8f64-4bb04fd0bb45 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:14.388245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:14.388838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:14.389120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:14.389393 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:14.390078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:14.390379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:14.391732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:14.399946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 634/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:14.405727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.501730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eca9e-4b15-45ae-9713-e2bea7f571dd None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:14.539122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:14.539737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:14.540017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:14.540288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:14.550668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:14.552162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:14.567629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:14.568551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:14.569465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:14.569465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:14.569465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:14.569465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 644/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:14.575083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.670461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44f92f-9d20-4764-9551-08227cd6d277 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:14.706715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:14.707316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:14.707592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:14.707868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:14.708590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:14.708931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:14.710401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:14.723564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 635/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:14.729791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.765143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:14.832496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92c7d-a188-45c0-9ebc-ae1c71f6a940 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:14.864511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:14.865127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:14.865409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:14.865683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:14.874301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:14.875681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:43:14.886885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:14.887991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:14.888973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 645/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:14.893759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:14.897521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:14.988883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ceae5-3835-42a8-a029-e8c813348fa8 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.021498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.022121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.022403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.022674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.023420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:15.023724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.025128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.041701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 636/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Wed Aug 24 05:43:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:15.047459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:15.140717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:15.150829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0892f-4346-4f20-b796-16e6528e6f88 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.184956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.185563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.185885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.186160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.252941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.254452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.341778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:15.352833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 646/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:43:15.358666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:15.419229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:15.456678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ccf8-c677-4058-9be3-aa723b7ba8c9 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.490536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.491160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.491445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.491722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.501382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.502854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:43:15.516773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:15.517929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:43:15.519034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:43:15.519034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:43:15.519034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:15.519034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 637/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:15.525649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:15.622984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f844-75c5-4294-aa4f-a550cb2cefe0 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.655419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.656018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.656303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.656575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.657210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:15.657513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.658898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.669744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 647/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:15.675457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:15.779123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ceae-d6e2-4ced-9e70-89dade5f1be3 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.792485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:15.812500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.813126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.813408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.813682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.820073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.822070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:43:15.832787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:15.833822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:43:15.834999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: ERROR keystone.server.flask.application Aug 24 05:43:15.837919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 638/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:15.840256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:15.888328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:15.937047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530530d4-814f-42ea-b906-2403cfc19b4c None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:15.968629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:15.969231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:15.969512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:15.969812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:15.970501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:15.970810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:15.972226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeeef9-041f-4d4c-81b3-0c736b4bb325 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:15.984117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 648/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:15.990486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:16.089058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ab41-fa01-4344-b0ce-e4de2aadf2e6 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:16.122328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:16.122920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:16.123208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:16.123487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:16.124209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] RBAC: Adding query filter params (role.id=e815260061204037a403daee014c9531, scope.project.id=41615b72a6f64c26851c96fec81cc2a7, user.id=9dccfa8372374f06b49680ed24b3020c) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:16.124522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:16.126053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec5ca7-2edd-4a62-a579-364153ca2215 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:16.131602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 639/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Wed Aug 24 05:43:15 2022] GET /identity/v3/role_assignments?user.id=9dccfa8372374f06b49680ed24b3020c&scope.project.id=41615b72a6f64c26851c96fec81cc2a7&role.id=e815260061204037a403daee014c9531 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:18.005256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729dd2-405b-4862-8974-a4e76c94d4f7 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:18.005748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729dd2-405b-4862-8974-a4e76c94d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:18.005880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729dd2-405b-4862-8974-a4e76c94d4f7 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:18.007186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 649/1288] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:18.012946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:18.013373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:18.013503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:18.031101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:18.032278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:18.061445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:18.097492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 640/1289] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:18.358475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729dd2-405b-4862-8974-a4e76c94d4f7 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:18.455304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729dd2-405b-4862-8974-a4e76c94d4f7 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:18.466936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:18.490288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:18.490913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:18.491195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:18.491464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:18.492098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:18.493445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:18.502187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:18.503425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:18.504474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:18.505933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 650/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:43:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:18.509166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:18.612511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793fe1-df12-4e2e-b536-9372e9140415 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:18.644515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:18.645115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:18.645399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:18.645672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:18.646338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:18.646644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:18.648001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92196-5af7-4c53-8a04-19591e2a12e7 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:18.653179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 641/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Wed Aug 24 05:43:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:18.658889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:18.764337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640f124-4e52-4f91-a0d6-b5ca736d08f8 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:18.796218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:18.796815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:18.797099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:18.797371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] PATH_INFO: `/v3/services` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:18.798019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] RBAC: Adding query filter params (type=placement) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:18.798321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:18.799665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a0b0-f20c-4a92-ae70-f16c0827a67d None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:18.803885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 651/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Wed Aug 24 05:43:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:20.666195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa34c-57fe-4775-864c-f1b021a80697 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:20.666716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa34c-57fe-4775-864c-f1b021a80697 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:20.666716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fa34c-57fe-4775-864c-f1b021a80697 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:20.668082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 642/1293] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:20.673118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac31e7-9b8b-4ab1-8fc3-a12b275c98a7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:20.673504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac31e7-9b8b-4ab1-8fc3-a12b275c98a7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:20.673674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac31e7-9b8b-4ab1-8fc3-a12b275c98a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:20.693873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d0ac31e7-9b8b-4ab1-8fc3-a12b275c98a7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:20.695090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d0ac31e7-9b8b-4ab1-8fc3-a12b275c98a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:20.724223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:20.760241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 652/1294] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:43:21.028297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fa34c-57fe-4775-864c-f1b021a80697 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:21.059573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:21.128458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fa34c-57fe-4775-864c-f1b021a80697 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:21.160473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:21.161066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:21.161348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:21.161622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:21.162300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:21.164179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f967e5-672f-4a1f-acbf-c8132ebf1f8e None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:21.178271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 643/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Wed Aug 24 05:43:21 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:43:23.056311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603bd99-d057-4ea5-b472-41f1193f4c64 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:23.056829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603bd99-d057-4ea5-b472-41f1193f4c64 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:23.056928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603bd99-d057-4ea5-b472-41f1193f4c64 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:23.058264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 653/1296] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:23.063448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293478-a4d8-4404-9012-033508f55b10 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:23.063859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293478-a4d8-4404-9012-033508f55b10 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:23.063999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293478-a4d8-4404-9012-033508f55b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:23.081464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-23293478-a4d8-4404-9012-033508f55b10 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:23.082694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-23293478-a4d8-4404-9012-033508f55b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:23.153286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 644/1297] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:23.416145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603bd99-d057-4ea5-b472-41f1193f4c64 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:23.515177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603bd99-d057-4ea5-b472-41f1193f4c64 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:23.547609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:23.548235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:23.548522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:23.548801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] PATH_INFO: `/v3/services/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:23.549388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:23.550804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:23.559381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:23.560592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:23.561489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 654/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:43:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:23.566437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293478-a4d8-4404-9012-033508f55b10 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:23.584607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:23.663559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293478-a4d8-4404-9012-033508f55b10 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:23.703026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:23.703830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:23.704118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:23.704394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:23.705306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:23.705757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:23.707623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:23.714482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 645/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Wed Aug 24 05:43:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:23.721382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:23.757163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:23.825093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5974fcf-8e29-4b0f-afd2-946bb340e45b None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:23.856908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:23.857514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:23.857821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:23.858101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:23.858809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] RBAC: Adding query filter params (interface=public, service_id=2289f27a16e8464fad9bf4e4cd2195c8, region_id=RegionOne) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:23.859124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:23.860480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e036a-4200-4890-981c-08b908f1e023 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:23.865271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 655/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Wed Aug 24 05:43:23 2022] GET /identity/v3/endpoints?service_id=2289f27a16e8464fad9bf4e4cd2195c8&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:23.871493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:23.950310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:23.968888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533e8be-4c03-4f9f-8aa8-05e9315ef537 None admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:24.001627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:24.002263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:24.002548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:24.002824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:24.003427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:24.004788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee3b1f-c6f6-4147-955d-338827ea2ea5 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:24.011961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 646/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Wed Aug 24 05:43:23 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:43:25.884619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d901d-a024-41aa-819f-eef03c5c1b21 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:25.885124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d901d-a024-41aa-819f-eef03c5c1b21 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:25.885124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d901d-a024-41aa-819f-eef03c5c1b21 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:25.886480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 656/1302] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:25.891533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:25.891942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:25.892086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:25.910327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:25.911486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:25.977099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 647/1303] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:43:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:43:26.242616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d901d-a024-41aa-819f-eef03c5c1b21 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:26.333388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:26.340485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d901d-a024-41aa-819f-eef03c5c1b21 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:26.372088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:26.372699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:26.372978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:26.373250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:26.373845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:26.375196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:43:26.384076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:43:26.385198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application with Lock( Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:43:26.386234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: ERROR keystone.server.flask.application Aug 24 05:43:26.390074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 657/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Wed Aug 24 05:43:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:43:26.391213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:26.464400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:26.487139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e9c0-dc00-4d99-b8ef-65573e167b44 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:26.521339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:26.521968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:26.522251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:26.522524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] PATH_INFO: `/v3/services` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:26.523710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:43:26.524008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:26.525365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb7f19-ffee-4c5a-ae49-ddc7fe41ce52 None admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:26.530341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 648/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Wed Aug 24 05:43:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:43:26.536211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:26.634327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04b03-c49b-41b8-b114-9b97a25fb555 None admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:26.666222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:26.666818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:26.667100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:26.667373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:26.668041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:26.669380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c67f70-8344-4c9c-bc3e-cbc5dcd290c0 None admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:26.690607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 658/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:43:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:43:36.527366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=30 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:36.685046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:29.954381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8cd8-3a25-45bf-a40b-df6e13f197f5 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:29.954800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8cd8-3a25-45bf-a40b-df6e13f197f5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:29.954800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8cd8-3a25-45bf-a40b-df6e13f197f5 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:29.960633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 649/1307] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:29.962050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ceef-3ed3-4cb2-897a-203cc0514caa None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:29.962446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ceef-3ed3-4cb2-897a-203cc0514caa None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:29.962544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ceef-3ed3-4cb2-897a-203cc0514caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:30.077383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-05b0ceef-3ed3-4cb2-897a-203cc0514caa None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:30.079037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-05b0ceef-3ed3-4cb2-897a-203cc0514caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.222574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 659/1308] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:44:30.534324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:30.534842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:30.535773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:30.537262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 650/1309] 10.222.0.61 () {54 vars in 965 bytes} [Wed Aug 24 05:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:30.543538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3dd3-d75b-4048-ad2b-f18f68545eaa None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:30.543832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3dd3-d75b-4048-ad2b-f18f68545eaa None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:30.544106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3dd3-d75b-4048-ad2b-f18f68545eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:30.636826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-260d3dd3-d75b-4048-ad2b-f18f68545eaa None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:30.638084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-260d3dd3-d75b-4048-ad2b-f18f68545eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.661972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:30.730665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 660/1310] 10.222.0.61 () {58 vars in 1062 bytes} [Wed Aug 24 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:30.739524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:30.741377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.856035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa96d-7c8c-4709-ac07-5ac959b88dcd None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:30.931597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:30.932369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:30.932752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:30.933147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:30.934897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:30.992174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:31.050849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:31.052496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd50c1-136c-4854-b160-749b77011d23 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:31.073997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 651/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:33.267497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:33.268023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:33.268103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:33.270190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 661/1312] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:33.275933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878775-58cb-43f8-b16d-293d55e2b399 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:33.276426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878775-58cb-43f8-b16d-293d55e2b399 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:33.276554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878775-58cb-43f8-b16d-293d55e2b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:33.364615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-08878775-58cb-43f8-b16d-293d55e2b399 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:33.365972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-08878775-58cb-43f8-b16d-293d55e2b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:33.472660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 652/1313] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:33.757961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:33.759572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:33.862289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64a35-e2db-4aec-9563-744f3857e599 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:33.933120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:33.935674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:33.936490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:33.936943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:33.937438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:33.939079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:34.049184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:34.051217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2009-bf34-4fe3-b562-1b9cc2fc219b service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:34.071527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 662/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:36.263737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ccfb-4dc8-496c-8de0-0e411a4e010c None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:36.264266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ccfb-4dc8-496c-8de0-0e411a4e010c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:36.264360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ccfb-4dc8-496c-8de0-0e411a4e010c None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:36.265651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 653/1315] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:36.271319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbf802-a9d7-42fe-b09a-206c3f24858e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:36.271733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbf802-a9d7-42fe-b09a-206c3f24858e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:36.271875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbf802-a9d7-42fe-b09a-206c3f24858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:36.335681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c0dbf802-a9d7-42fe-b09a-206c3f24858e None None] MFA Rules not processed for user `5f6e22c993174f38bce5d39110d85361`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:36.336882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c0dbf802-a9d7-42fe-b09a-206c3f24858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:36.387736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:36.430950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 663/1316] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:44:36.729022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:36.729341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:36.729621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:36.731025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 654/1317] 10.222.0.61 () {54 vars in 965 bytes} [Wed Aug 24 05:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:36.736725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5635f-ca28-47ee-a9f0-676fefac8279 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:36.737015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5635f-ca28-47ee-a9f0-676fefac8279 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:36.737294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5635f-ca28-47ee-a9f0-676fefac8279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:36.813244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-70a5635f-ca28-47ee-a9f0-676fefac8279 None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:36.814406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-70a5635f-ca28-47ee-a9f0-676fefac8279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:36.888536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 664/1318] 10.222.0.61 () {58 vars in 1062 bytes} [Wed Aug 24 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:36.897940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:36.899506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:36.909013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:37.002122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a56a-fe94-4d5a-86f0-03f24909ab70 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:37.073803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:37.074423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:37.074710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:37.074988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:37.076602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:37.138374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:37.184553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:37.186016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ad08d-e01f-413d-8c57-87735fc2a369 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:37.204152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 655/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:39.964404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:39.964931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:39.965040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:39.966600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 665/1320] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:39.971771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18f97-f6a6-474c-b125-f175b19f7059 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:39.972701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18f97-f6a6-474c-b125-f175b19f7059 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:39.972874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18f97-f6a6-474c-b125-f175b19f7059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:40.037680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0ae18f97-f6a6-474c-b125-f175b19f7059 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:40.038908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0ae18f97-f6a6-474c-b125-f175b19f7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:40.133496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 656/1321] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:40.413553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:40.415119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:40.463165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:40.515683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b26f6-9a1c-4b23-8b0d-5e416caf646d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:40.586341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:40.586954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:40.587234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:40.587504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:40.589075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:40.683394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:40.698030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:40.699483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ec34c-efc8-493d-b185-eec4a6564587 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:40.718144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 666/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:43.271656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:43.272286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:43.272383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:43.273858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 657/1323] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:43.279141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a38f0-5cf5-404d-9aaf-6e43516d618d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:43.279574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a38f0-5cf5-404d-9aaf-6e43516d618d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:43.279697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a38f0-5cf5-404d-9aaf-6e43516d618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:43.345776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-af8a38f0-5cf5-404d-9aaf-6e43516d618d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:43.347550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-af8a38f0-5cf5-404d-9aaf-6e43516d618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:43.445832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 667/1324] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:43.732762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:43.734348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:43.754134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:43.847176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ebe2-9b65-4d7e-83f3-b3ddd76ee43b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:43.920954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:43.921480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:43.921775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:43.922062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:43.923665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:44.001369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:44.039504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:44.040951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317c968-1c15-4c41-8244-0f2f5fb4ca32 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:44.059369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 658/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:46.038762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:46.039286 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:46.039375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:46.040675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 668/1326] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:46.046144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ba3c-433f-4098-b5ed-1eded91e134e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:46.046539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ba3c-433f-4098-b5ed-1eded91e134e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:46.046708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ba3c-433f-4098-b5ed-1eded91e134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:46.113312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d0f6ba3c-433f-4098-b5ed-1eded91e134e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:46.114561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d0f6ba3c-433f-4098-b5ed-1eded91e134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:46.213834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 659/1327] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:46.497017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:46.498588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:46.574210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:46.618627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aec7a1-c456-4a76-8fa3-df1f2024a56b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:46.690357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:46.691025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:46.691320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:46.691623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:46.693462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:46.808189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:46.810711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:46.812460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf7ba4-f345-4d6c-9ad9-af72aaea60b4 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:46.832217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 669/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:48.782235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:48.782805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:48.782805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:48.784205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 660/1329] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:48.790219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be6c7-6f27-4cc1-839a-8e8f92eb7a0d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:48.790751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be6c7-6f27-4cc1-839a-8e8f92eb7a0d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:48.790846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be6c7-6f27-4cc1-839a-8e8f92eb7a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:48.855847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-fc0be6c7-6f27-4cc1-839a-8e8f92eb7a0d None None] MFA Rules not processed for user `5f6e22c993174f38bce5d39110d85361`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:48.857039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fc0be6c7-6f27-4cc1-839a-8e8f92eb7a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:48.951534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 670/1330] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:49.231265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:49.232847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:49.268161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:49.343532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18b9ba-e037-45a3-9637-8e20cf170b5f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:49.423852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:49.424394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:49.424677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:49.425075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:49.426733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:49.507535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:49.542445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:49.544105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43165c-4516-403b-9110-e83a4da54882 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:49.563899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 661/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:51.707017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:51.707590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:51.707590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:51.708839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 671/1332] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:51.713934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1511025-e41c-43b5-835d-1bc6048dc539 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:51.714366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1511025-e41c-43b5-835d-1bc6048dc539 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:51.714478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1511025-e41c-43b5-835d-1bc6048dc539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:51.778920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d1511025-e41c-43b5-835d-1bc6048dc539 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:51.780121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d1511025-e41c-43b5-835d-1bc6048dc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:51.876964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 662/1333] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:52.154963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:52.156525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:52.225937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:52.259342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e6986-35d8-4726-8dfa-9793aaa0e4ca None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:52.330199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:52.330813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:52.331606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:52.331911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:52.333513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:52.440504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:52.441928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849a01-67cd-4bd8-a81d-24db11f90cf1 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:52.451624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:52.461054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 672/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:54.381237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:54.381849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:54.381849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:54.383157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 663/1335] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:54.388370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b24-847c-4d4b-8409-19bff062de9d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:54.388786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b24-847c-4d4b-8409-19bff062de9d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:54.388940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b24-847c-4d4b-8409-19bff062de9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:54.453415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7bac0b24-847c-4d4b-8409-19bff062de9d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:54.454648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7bac0b24-847c-4d4b-8409-19bff062de9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:54.549425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 673/1336] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:54.832212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:54.833755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:54.873926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:54.936570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ecff6-b323-4920-acfb-6c105a32936a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:55.008210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:55.008816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:55.009096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:55.009367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:55.010991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:55.091023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:55.117171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:55.118632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a2b9c-2625-4ac9-a70a-940a476fa798 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:55.136196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 664/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:57.319356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:57.319883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:57.319883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:57.321245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 674/1338] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:57.326514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d128-c2cb-40b1-8bfb-49d839e0e09b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:57.326913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d128-c2cb-40b1-8bfb-49d839e0e09b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:57.327079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d128-c2cb-40b1-8bfb-49d839e0e09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:57.393647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-67e8d128-c2cb-40b1-8bfb-49d839e0e09b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:57.394880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-67e8d128-c2cb-40b1-8bfb-49d839e0e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:57.488144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 665/1339] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:44:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:57.781004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:57.782572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:57.857552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:57.889222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b55b64-01a3-47ae-a887-290ada22355a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:57.964360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:57.965218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:57.965499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:57.965791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:57.967387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:58.072739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:58.074115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ccdf-faf8-4de7-a186-5cd826a465e8 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:58.092093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 675/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:01.873819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.874363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.874363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.875746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 666/1341] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:01.881108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775dd6e-a86b-44b3-b192-94c827ea4605 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:01.881546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775dd6e-a86b-44b3-b192-94c827ea4605 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:01.881644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775dd6e-a86b-44b3-b192-94c827ea4605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:01.887093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:01.948250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e775dd6e-a86b-44b3-b192-94c827ea4605 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:01.949358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e775dd6e-a86b-44b3-b192-94c827ea4605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.049295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 676/1342] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:02.335387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:02.336953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.385833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:02.440966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4675f2a-c8da-4507-ad88-8bc4d54e9980 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:02.512889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:02.513491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:02.513791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:02.514070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:02.515650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:02.608641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:02.625797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:02.627282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b924201-4c89-4c36-bb61-daeb1e72fdbf service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:02.645596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 667/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:05.189841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:05.190361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:05.190481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:05.191733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 677/1344] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:05.196775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37367dd-8bc9-412c-89d5-918676e420b5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:05.197231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37367dd-8bc9-412c-89d5-918676e420b5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:05.197324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37367dd-8bc9-412c-89d5-918676e420b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:05.262930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e37367dd-8bc9-412c-89d5-918676e420b5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:05.264118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e37367dd-8bc9-412c-89d5-918676e420b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:05.359420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 668/1345] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:05.639782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:05.641329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:05.734642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:05.751918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937df40-e737-4910-a2ea-09b608e47e7c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:05.829263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:05.829823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:05.830108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:05.830946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:05.832566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:05.941714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:05.943183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23367558-7c90-4252-93fb-3aa18a3cbd7e service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:05.961871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 678/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:09.803054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:09.803499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:09.803762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:09.805254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 669/1347] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:09.811065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16089f-44aa-4e8e-821c-c2c4d0b8c6be None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:09.811465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16089f-44aa-4e8e-821c-c2c4d0b8c6be None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:09.811625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16089f-44aa-4e8e-821c-c2c4d0b8c6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:09.834281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:09.885369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7a16089f-44aa-4e8e-821c-c2c4d0b8c6be None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:09.886634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7a16089f-44aa-4e8e-821c-c2c4d0b8c6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:09.995853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 679/1348] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:10.277754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:10.279311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:10.338659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:10.385698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7224261-9c51-4943-8365-bc745e2969ed None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:10.462550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:10.463167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:10.463451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:10.463733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:10.465590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:10.571224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:10.572675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:10.574214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6c0bf-d3f1-4d63-9757-8b7cd3f5165b service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:10.593383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 670/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:15.455996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7354-3161-4c48-90b5-951b02633f34 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.456417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7354-3161-4c48-90b5-951b02633f34 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.456761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7354-3161-4c48-90b5-951b02633f34 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.459956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 680/1350] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:15.465122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f69c-1023-4bcd-948d-e6fab6b238f7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:15.465560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f69c-1023-4bcd-948d-e6fab6b238f7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:15.465742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f69c-1023-4bcd-948d-e6fab6b238f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:15.567281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-66f6f69c-1023-4bcd-948d-e6fab6b238f7 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:15.568656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-66f6f69c-1023-4bcd-948d-e6fab6b238f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:15.770668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 671/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:19.923144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c61f7-bdd3-487d-84da-76ba0b0d12c3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:19.924556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c61f7-bdd3-487d-84da-76ba0b0d12c3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:19.924986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c61f7-bdd3-487d-84da-76ba0b0d12c3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:19.926368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 681/1352] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:19.931382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2e27-509a-4a29-b263-365ee5971868 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:19.931795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2e27-509a-4a29-b263-365ee5971868 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:19.932009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2e27-509a-4a29-b263-365ee5971868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:19.988088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:19.993842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=59 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:20.018024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6fbd2e27-509a-4a29-b263-365ee5971868 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:20.019334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6fbd2e27-509a-4a29-b263-365ee5971868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:20.134633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 672/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:21.556630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9389952-6b18-46e4-bcf6-1f46b2a9f06e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:21.557141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9389952-6b18-46e4-bcf6-1f46b2a9f06e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:21.557256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9389952-6b18-46e4-bcf6-1f46b2a9f06e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:21.558537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 682/1354] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:21.563618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f632-4dac-4e78-ba89-88e38e71a7a0 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:21.565086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f632-4dac-4e78-ba89-88e38e71a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:21.565430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f632-4dac-4e78-ba89-88e38e71a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:21.644510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a495f632-4dac-4e78-ba89-88e38e71a7a0 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:21.645680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a495f632-4dac-4e78-ba89-88e38e71a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:21.686037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:21.750650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 673/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:45:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:25.117645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f909-3e78-46ff-83d3-194384d4dd6d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:25.118224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f909-3e78-46ff-83d3-194384d4dd6d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:25.118224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f909-3e78-46ff-83d3-194384d4dd6d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:25.119566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 683/1356] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:25.124890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f567-d77b-41ee-8e77-85da6ba3957e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:25.125284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f567-d77b-41ee-8e77-85da6ba3957e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:25.125444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f567-d77b-41ee-8e77-85da6ba3957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:25.201892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9975f567-d77b-41ee-8e77-85da6ba3957e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:25.203084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9975f567-d77b-41ee-8e77-85da6ba3957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:25.338400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 674/1357] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:25.642711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:25.643400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:25.643903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:25.645727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 684/1358] 10.222.0.61 () {54 vars in 962 bytes} [Wed Aug 24 05:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:25.654794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db522f-5a6e-47a2-ac41-14834b93105a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:25.655364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db522f-5a6e-47a2-ac41-14834b93105a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:25.655865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db522f-5a6e-47a2-ac41-14834b93105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:25.679084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:25.742215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-96db522f-5a6e-47a2-ac41-14834b93105a None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:25.743395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-96db522f-5a6e-47a2-ac41-14834b93105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:25.870726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 675/1359] 10.222.0.61 () {58 vars in 1059 bytes} [Wed Aug 24 05:45:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:25.880405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:25.882171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:26.041678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f10bcb-ae94-44c7-b83a-f1f98504eda3 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:26.120649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:26.163295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:26.163904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:26.164193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:26.164453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:26.166062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:26.260811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:26.262921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff363d-bc2b-4212-9fbf-1cffdfaa9362 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:26.282255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 685/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:28.396400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.396865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.397011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.398494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 676/1361] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:28.403850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098227d6-4992-43d8-a37b-1bd574df4d4a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:28.404386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098227d6-4992-43d8-a37b-1bd574df4d4a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:28.404386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098227d6-4992-43d8-a37b-1bd574df4d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:28.473887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-098227d6-4992-43d8-a37b-1bd574df4d4a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:28.475028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-098227d6-4992-43d8-a37b-1bd574df4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:28.514666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:28.581319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 686/1362] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:28.882149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:28.883233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:28.949790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:29.039234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49bb4-4a0e-4e45-b332-68729c7dcfb7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:29.164080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:29.164713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:29.165141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:29.165420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:29.167188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:29.191124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:29.275674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:29.277890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172864b-31a4-4666-9d99-e9e9d46d397b service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:29.303152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 677/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:31.573639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62af5-cf65-4999-bf61-4efb400c2f06 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:31.574273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62af5-cf65-4999-bf61-4efb400c2f06 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:31.574273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b62af5-cf65-4999-bf61-4efb400c2f06 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:31.575579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 687/1364] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:31.581537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24195-53e8-43b1-8adf-a403b580dce5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:31.582120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24195-53e8-43b1-8adf-a403b580dce5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:31.582120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24195-53e8-43b1-8adf-a403b580dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:31.652637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-15e24195-53e8-43b1-8adf-a403b580dce5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:31.653787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-15e24195-53e8-43b1-8adf-a403b580dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:31.781929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:31.785907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 678/1365] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:32.077366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:32.077793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:32.078216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:32.080402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 688/1366] 10.222.0.61 () {54 vars in 962 bytes} [Wed Aug 24 05:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:32.087453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0841ba-444a-47be-b35f-521438827bbb None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:32.087770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0841ba-444a-47be-b35f-521438827bbb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:32.088053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0841ba-444a-47be-b35f-521438827bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:32.166943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fa0841ba-444a-47be-b35f-521438827bbb None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:32.168162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fa0841ba-444a-47be-b35f-521438827bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:32.295085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 679/1367] 10.222.0.61 () {58 vars in 1059 bytes} [Wed Aug 24 05:45:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:32.303620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:32.305341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:32.462984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fed6c2-3de2-43ad-baa0-86569de540ee None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:32.484955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:32.593621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:32.594285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:32.594592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:32.594839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:32.596425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:32.689486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:32.691209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed9e16-222a-494b-9a50-9c8d61b7d778 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:32.713064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 689/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:33.344422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dc50-23b4-448c-90e4-04fd55a15064 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:33.344949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dc50-23b4-448c-90e4-04fd55a15064 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:33.344949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888dc50-23b4-448c-90e4-04fd55a15064 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:33.346521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 680/1369] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:33.351913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215a3-1ed6-4b22-8c72-213de578294f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:33.352230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215a3-1ed6-4b22-8c72-213de578294f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:33.352549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215a3-1ed6-4b22-8c72-213de578294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:33.388535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:33.429504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2ec215a3-1ed6-4b22-8c72-213de578294f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:33.430763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2ec215a3-1ed6-4b22-8c72-213de578294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:33.531411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 690/1370] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:34.130708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:34.130999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:34.131450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:34.133010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 681/1371] 10.222.0.61 () {54 vars in 964 bytes} [Wed Aug 24 05:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:34.138249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7027b9-a70b-44ef-a62e-926ea0bd9a05 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:34.138702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7027b9-a70b-44ef-a62e-926ea0bd9a05 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:34.138795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7027b9-a70b-44ef-a62e-926ea0bd9a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:34.218487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5c7027b9-a70b-44ef-a62e-926ea0bd9a05 None None] MFA Rules not processed for user `6ccf6d1dd8cc49b385c569206fcfdbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:34.220758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5c7027b9-a70b-44ef-a62e-926ea0bd9a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:34.271161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:34.304433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 691/1372] 10.222.0.61 () {58 vars in 1061 bytes} [Wed Aug 24 05:45:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:34.312207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:34.313855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:34.370111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:34.428900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811c714-3e4c-4ea9-b6c9-ed6874dd2912 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:34.510470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:34.511129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:34.512203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:34.512203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:34.513563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:34.616751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:34.630924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:34.632355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62322605-a0ba-4b77-9719-2b834550f3bb service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:34.657212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 682/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:34.680710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:34.681011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:34.681294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:34.682808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 692/1374] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:34.691769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a032ec-10c0-4e70-985b-bd455b38c648 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:34.692155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a032ec-10c0-4e70-985b-bd455b38c648 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:34.692488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a032ec-10c0-4e70-985b-bd455b38c648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:34.769803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a8a032ec-10c0-4e70-985b-bd455b38c648 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:34.771751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a8a032ec-10c0-4e70-985b-bd455b38c648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:34.873970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 683/1375] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:35.157553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:35.159137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:35.309146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ea46a-680e-4d7d-868b-7976905b4211 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:35.364795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:35.430105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:35.430741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:35.431290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:35.431566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:35.433191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:35.523703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:35.525306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea9e1-2cf1-45c2-afda-e513f8f80214 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:35.543587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 693/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:37.463892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:37.464383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:37.464477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:37.465809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 684/1377] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:37.471001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429370ff-4b25-4a37-af3b-b75d85763eb1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:37.471416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429370ff-4b25-4a37-af3b-b75d85763eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:37.471584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429370ff-4b25-4a37-af3b-b75d85763eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:37.544984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-429370ff-4b25-4a37-af3b-b75d85763eb1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:37.546217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-429370ff-4b25-4a37-af3b-b75d85763eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:37.557383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:37.658739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 694/1378] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:37.952465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:37.954249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:38.020807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:38.140822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042889c9-187d-4721-907e-db62f6c6ced2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:38.273131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:38.274055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:38.274525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:38.274898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:38.276597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:38.298593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:38.379829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:38.381755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e36b-e8cb-46fd-9bd9-6cf50e38c1f6 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:38.402011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 685/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:40.330333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.330886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.330886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.332372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 695/1380] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:40.337339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c269f-9f80-4f14-a01f-0049a3296531 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:40.338742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c269f-9f80-4f14-a01f-0049a3296531 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:40.338742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c269f-9f80-4f14-a01f-0049a3296531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:40.404615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-579c269f-9f80-4f14-a01f-0049a3296531 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:40.405807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-579c269f-9f80-4f14-a01f-0049a3296531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:40.503699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:40.518222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 686/1381] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:40.798973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:40.800467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:40.938353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:40.949398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44f15-7cfc-4c8b-a9f0-d77a30dca27d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:41.082619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:41.083158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:41.083447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:41.083728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:41.085337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:41.183363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:41.184967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f00b3-a201-473d-83df-c51320b6af87 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:41.195788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:41.206861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 696/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:43.139744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:43.140274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:43.140274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:43.142226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 687/1383] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:43.147674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fe5d-6175-415e-a7e0-fcc06596eee8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:43.148229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fe5d-6175-415e-a7e0-fcc06596eee8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:43.148229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fe5d-6175-415e-a7e0-fcc06596eee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:43.217146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-49e0fe5d-6175-415e-a7e0-fcc06596eee8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:43.218414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-49e0fe5d-6175-415e-a7e0-fcc06596eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:43.316257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 697/1384] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:43.604855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:43.606418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:43.777810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc67d-3f66-4695-9d17-7a9ec8b6ea5a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:43.848049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:43.895425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:43.896040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:43.896319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:43.896593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:43.898239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:44.002941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:44.004569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f373c91-c8ac-42a0-afa7-b9157e187c15 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:44.023166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 688/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:45.933846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:45.934408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:45.934647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:45.936446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 698/1386] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:45.942518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb04bb-65b6-4f85-9ffc-e9e64c729e0b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:45.942979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb04bb-65b6-4f85-9ffc-e9e64c729e0b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:45.943071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb04bb-65b6-4f85-9ffc-e9e64c729e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:46.024840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9ebb04bb-65b6-4f85-9ffc-e9e64c729e0b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:46.026106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9ebb04bb-65b6-4f85-9ffc-e9e64c729e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:46.058460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.124984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 689/1387] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:46.415224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:46.416740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:46.501216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.580034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97717d-b54d-4344-95c2-f56c8b10b01b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:46.714892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:46.715349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:46.715636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:46.715911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:46.717525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:46.756566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.820298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:46.822689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91dba-2dca-4126-a419-6fb3a41feda4 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:46.847242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 699/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:48.787977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:48.788533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:48.788533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:48.789912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 690/1389] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:48.795220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7665a-02b2-4b93-a194-c9225cc28703 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:48.795598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7665a-02b2-4b93-a194-c9225cc28703 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:48.795779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7665a-02b2-4b93-a194-c9225cc28703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:48.863283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f9c7665a-02b2-4b93-a194-c9225cc28703 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:48.864521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f9c7665a-02b2-4b93-a194-c9225cc28703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:48.959355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 700/1390] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:49.248341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:49.249930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.396607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e057cc-43d8-4690-a2dd-1348d376c078 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:49.413694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:49.511129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:49.511853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.512143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.512421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.514055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.606900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15867ec-ef53-4dd1-b793-88639fbac1c6 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.607196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15867ec-ef53-4dd1-b793-88639fbac1c6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.607478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15867ec-ef53-4dd1-b793-88639fbac1c6 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.608782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:49.608894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 701/1391] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:45:49.610610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204b5e-4f07-41a5-ad52-5d7ed7bbba38 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:49.614108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44abce-53b5-4af7-9ddb-80f5c5a30546 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.614405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44abce-53b5-4af7-9ddb-80f5c5a30546 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.614684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44abce-53b5-4af7-9ddb-80f5c5a30546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.629918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 691/1392] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:49.630704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:49.682225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-db44abce-53b5-4af7-9ddb-80f5c5a30546 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:49.683425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-db44abce-53b5-4af7-9ddb-80f5c5a30546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.795887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 702/1393] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:50.101438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.101893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.102138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.103835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 692/1394] 10.222.0.61 () {54 vars in 967 bytes} [Wed Aug 24 05:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:50.109171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7bcf-864a-4673-91a0-ec1d4f245c7b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.109464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7bcf-864a-4673-91a0-ec1d4f245c7b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.109919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7bcf-864a-4673-91a0-ec1d4f245c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.185736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0c7b7bcf-864a-4673-91a0-ec1d4f245c7b None None] MFA Rules not processed for user `0ff470a005324829a2d9ada970436094`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.186982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0c7b7bcf-864a-4673-91a0-ec1d4f245c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.231540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.285243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 703/1395] 10.222.0.61 () {58 vars in 1064 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.292904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.294478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.318468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.400144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afb7f0-c146-4d4f-8dce-48f0a32cf295 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.474428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.475043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.475334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.475609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.477217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.553551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.593412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.594917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8acd8-9f89-46a0-98ce-fee381c83e2e service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.613430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 693/1396] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:51.342711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bc5b3-5a84-4a7d-9154-05a8fdf24664 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.343190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bc5b3-5a84-4a7d-9154-05a8fdf24664 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.343357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bc5b3-5a84-4a7d-9154-05a8fdf24664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.412896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b65bc5b3-5a84-4a7d-9154-05a8fdf24664 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:51.414079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b65bc5b3-5a84-4a7d-9154-05a8fdf24664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:51.504855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 704/1397] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:51.548564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a82f-1281-452a-9239-395954f87427 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.549064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a82f-1281-452a-9239-395954f87427 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.549269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a82f-1281-452a-9239-395954f87427 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.550973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 694/1398] 10.222.0.61 () {54 vars in 943 bytes} [Wed Aug 24 05:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:51.557874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.558169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.558448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.571196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99290-5fcd-46f8-8c20-ba10d6606410 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.571791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99290-5fcd-46f8-8c20-ba10d6606410 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.572082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99290-5fcd-46f8-8c20-ba10d6606410 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.573469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 695/1399] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:45:51.579294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.579581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.579855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.619025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.638398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] MFA Rules not processed for user `d978a00f91b1435f9662492df2d52fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:51.639637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:51.646809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:51.647928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:51.748317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 696/1400] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:51.750846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 705/1401] 10.222.0.61 () {58 vars in 1040 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:51.760640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.762007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:51.792660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.863438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e22a-ce28-4d4f-8d0f-4479a68edeb7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.965187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.965724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.966036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.966308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.967959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.020625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.036245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.037458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.055721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.057637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0b561-88b8-4402-9121-bbadca5b1606 service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.066288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 697/1402] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:45:52.139600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f6e75-1e6e-4e12-b6c8-21dcfedb1851 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.161073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.292304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.293083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.293444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.293725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.295383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.393194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.394839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1933-2952-4d08-a678-f6fabb66af9e service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.417414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 706/1403] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:54.364503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195218e8-0c12-40a3-8c31-46693593305b None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.365095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195218e8-0c12-40a3-8c31-46693593305b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.365095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195218e8-0c12-40a3-8c31-46693593305b None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.366445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 698/1404] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:54.371688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2905e-1c7b-405d-9b80-a6ba89e1fd92 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.372151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2905e-1c7b-405d-9b80-a6ba89e1fd92 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.372265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2905e-1c7b-405d-9b80-a6ba89e1fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.400001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:54.450762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-dbe2905e-1c7b-405d-9b80-a6ba89e1fd92 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:54.450762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dbe2905e-1c7b-405d-9b80-a6ba89e1fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:54.569818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 707/1405] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:54.848033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195218e8-0c12-40a3-8c31-46693593305b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:54.849659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-195218e8-0c12-40a3-8c31-46693593305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.016131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195218e8-0c12-40a3-8c31-46693593305b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:55.062282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:55.146392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:55.146954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.147242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.147520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.149149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.248826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:55.251057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4eff-043a-467f-a3b3-64cd14b39c94 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:55.269824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 699/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:57.315793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.316426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.316426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.317862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 708/1407] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:57.323008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205129-3cd8-4468-9a30-7f8e1c27809d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.323447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205129-3cd8-4468-9a30-7f8e1c27809d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.323584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205129-3cd8-4468-9a30-7f8e1c27809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.391351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:57.405967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d3205129-3cd8-4468-9a30-7f8e1c27809d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:57.407766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d3205129-3cd8-4468-9a30-7f8e1c27809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.517252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 700/1408] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:57.817905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:57.819550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.923265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:57.982160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1baf77-9af3-4fbc-a87c-e2cb85e3cb3b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.105382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.105963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.106227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.106508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.108342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:58.171938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:58.205890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.207646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef6c0-9c6f-41a9-b6d4-55dad6e638dc service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.227447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 709/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:07.514544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=44 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:08.224860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=19 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.269205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd9e-0f4a-4ae3-b8d1-d97165184804 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.269795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd9e-0f4a-4ae3-b8d1-d97165184804 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.269795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd9e-0f4a-4ae3-b8d1-d97165184804 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.271131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 701/1410] 10.222.0.61 () {54 vars in 918 bytes} [Wed Aug 24 05:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:14.276306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43555c0-87ab-4bb2-8af9-66aefcbbabde None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.276718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43555c0-87ab-4bb2-8af9-66aefcbbabde None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.276851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43555c0-87ab-4bb2-8af9-66aefcbbabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.351390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b43555c0-87ab-4bb2-8af9-66aefcbbabde None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:14.352588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b43555c0-87ab-4bb2-8af9-66aefcbbabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.457244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 710/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Aug 24 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:14.472451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e15a8-4ffc-4d03-973c-27c9f4220990 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.472741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e15a8-4ffc-4d03-973c-27c9f4220990 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.473053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e15a8-4ffc-4d03-973c-27c9f4220990 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.474458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 702/1412] 10.222.0.61 () {54 vars in 918 bytes} [Wed Aug 24 05:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:14.478935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa90d-1539-431f-803a-8832c7bb9ad7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.479229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa90d-1539-431f-803a-8832c7bb9ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.479507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa90d-1539-431f-803a-8832c7bb9ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.551721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.555112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0e1fa90d-1539-431f-803a-8832c7bb9ad7 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:14.556998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0e1fa90d-1539-431f-803a-8832c7bb9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.672340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 711/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Aug 24 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:17.034294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.034801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.034920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.036202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:17.041560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ad0-0e6d-4263-a854-ce5c763ef197 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.041999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ad0-0e6d-4263-a854-ce5c763ef197 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.042156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ad0-0e6d-4263-a854-ce5c763ef197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.106716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-50572ad0-0e6d-4263-a854-ce5c763ef197 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:17.107902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-50572ad0-0e6d-4263-a854-ce5c763ef197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.166304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:17.209442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:17.499503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.501036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.647156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e57ba-9a88-47ad-8282-1570464b0871 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.719277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:17.759149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.759757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.760036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.760309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.761934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.850713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.852316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835ae26-a818-4540-97bf-0981d5e77574 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.869699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 704/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:18.758384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.759137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.759137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.760286 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:18.766075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a454-b90f-42d5-88f5-d2f01210acbd None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.766520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a454-b90f-42d5-88f5-d2f01210acbd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.766626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a454-b90f-42d5-88f5-d2f01210acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.841228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8652a454-b90f-42d5-88f5-d2f01210acbd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:18.842408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8652a454-b90f-42d5-88f5-d2f01210acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:18.868928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.943313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:19.092089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.093645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.238909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d0aa2-33d7-4f84-a864-2d0c9dbbbe4e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.278367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.354460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.354989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.355274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.355548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.357147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.444879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.446510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b627052-881a-47bf-93f3-9125f0f62f67 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.464274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 714/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:20.343870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.344399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.344399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.345996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:20.350952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2ad0-b4e9-416a-ba15-89674c96b07a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.351382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2ad0-b4e9-416a-ba15-89674c96b07a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.351516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2ad0-b4e9-416a-ba15-89674c96b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.406913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.429604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-513e2ad0-b4e9-416a-ba15-89674c96b07a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:20.430876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-513e2ad0-b4e9-416a-ba15-89674c96b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.526970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:20.677557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.679154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.822623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126dbc4-6c52-447f-9bf0-82dc4bb5034e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.835270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.936823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.937439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.937725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.938051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.941043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.032805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.034458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e3e30-a4b6-440c-ae37-c3e89c661393 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.052168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 707/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:21.905743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.906340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.906340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.907660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:21.912459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0524-73b6-4749-b1a9-ba06c94363e7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.912899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0524-73b6-4749-b1a9-ba06c94363e7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.913026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0524-73b6-4749-b1a9-ba06c94363e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.933083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:21.989254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-648b0524-73b6-4749-b1a9-ba06c94363e7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:21.990488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-648b0524-73b6-4749-b1a9-ba06c94363e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.085305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:22.236623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:22.238073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.344498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:22.379764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866931c2-d839-4c08-ad7f-18a82294b4c0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:22.490474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:22.490994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.491277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.491552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.493146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.570307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:22.584047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:22.585636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9e5f-623d-4adb-a698-d16a20fb7b04 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:22.603404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 717/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:23.464533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.464989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.465115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.466536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:23.471953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152da5-c265-4932-94d8-630427f5ca01 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.472360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152da5-c265-4932-94d8-630427f5ca01 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.472520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152da5-c265-4932-94d8-630427f5ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.548596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a0152da5-c265-4932-94d8-630427f5ca01 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:23.549864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a0152da5-c265-4932-94d8-630427f5ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.645887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:23.796866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.798412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.881753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:23.943439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e941696-1f22-47c3-9137-004353e4e2bc None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.055864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.056552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.056930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.057298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.059053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.107190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:24.150414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.152015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4509b-d3c2-46ae-9a79-90c6f5143aa3 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.169562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 710/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:24.978454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.978960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.978960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.980277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:24.986043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555dc3-ef2a-41ba-b953-45614c2c8729 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.986454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555dc3-ef2a-41ba-b953-45614c2c8729 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.986599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555dc3-ef2a-41ba-b953-45614c2c8729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.060812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-41555dc3-ef2a-41ba-b953-45614c2c8729 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.062092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-41555dc3-ef2a-41ba-b953-45614c2c8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.157284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:25.307015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.308529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.356601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:25.453104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30628-ed88-42e4-a8cf-ca6690a662ce None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.565635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.566215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.566497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.566768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.568365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.575382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:25.658209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.659790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f632a2-539e-4eb1-9ed2-1203054b49d7 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.677679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 720/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:26.476296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.476832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.476832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.478258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:26.483721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32224c-7e58-47d7-8b9e-663d9a075537 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.484160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32224c-7e58-47d7-8b9e-663d9a075537 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.484274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32224c-7e58-47d7-8b9e-663d9a075537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.558358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ec32224c-7e58-47d7-8b9e-663d9a075537 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:26.559578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ec32224c-7e58-47d7-8b9e-663d9a075537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.626484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:26.656133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:26.807003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.808731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.828658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:26.957078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c91f7-a363-4f3c-8a1e-22f4bbac1540 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.043656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:27.069751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.070395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.070680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.070957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.072561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.165742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.167387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33b9c-9c5e-49a8-a2a8-14fdce1ab157 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.184838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 713/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:27.984915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443378c-1afc-4853-94b1-178caee2918d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.985446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443378c-1afc-4853-94b1-178caee2918d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.985538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443378c-1afc-4853-94b1-178caee2918d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.986938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:27.992100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9d1b-1ed1-4925-958b-40a01d7ee4b9 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.992495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9d1b-1ed1-4925-958b-40a01d7ee4b9 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.992657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9d1b-1ed1-4925-958b-40a01d7ee4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.068058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ee9c9d1b-1ed1-4925-958b-40a01d7ee4b9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:28.069283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ee9c9d1b-1ed1-4925-958b-40a01d7ee4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.110984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:28.165824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:28.322003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443378c-1afc-4853-94b1-178caee2918d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.323537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5443378c-1afc-4853-94b1-178caee2918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.470237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443378c-1afc-4853-94b1-178caee2918d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.523713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:28.583243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.583792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.584074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.584349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.585965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.673827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.675414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c37ddf-eca5-4c80-8a89-90fc4c231306 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.692849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 723/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:29.503171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.503722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.503722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.505077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:29.510244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1c2-5d28-4a58-91f5-4d7b6b507aa7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.510661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1c2-5d28-4a58-91f5-4d7b6b507aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.510790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e1c2-5d28-4a58-91f5-4d7b6b507aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.585916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2293e1c2-5d28-4a58-91f5-4d7b6b507aa7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:29.587426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2293e1c2-5d28-4a58-91f5-4d7b6b507aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.589411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:29.683462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:29.833651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.835203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.978413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f371a-ddcf-4371-a926-e42da56d7e0b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.004983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.094381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.094997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.095285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.095566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.097166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.184877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.187031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93b7e9-8246-45a0-b87b-dc8e54e92ba6 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.205073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 716/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:32.008720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.009256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.009369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.010686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:32.016498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8a43-8ea7-41e4-a409-3d1ace1b2629 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.017526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8a43-8ea7-41e4-a409-3d1ace1b2629 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.017933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d8a43-8ea7-41e4-a409-3d1ace1b2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.059690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.084716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-169d8a43-8ea7-41e4-a409-3d1ace1b2629 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.085977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-169d8a43-8ea7-41e4-a409-3d1ace1b2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.181074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:32.463622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.465159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.567851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff37c-73dc-4d98-b3ea-eb5fe53ae03f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.600000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.641461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.642097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.642380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.642653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.644246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.750732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.752093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114203cd-ac69-4c4f-991b-7af9e12f2fd9 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.772041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 726/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:34.801483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.802080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.802080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.803488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:34.808536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162e56-2c08-46f5-ac94-461e5fc18101 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.808907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162e56-2c08-46f5-ac94-461e5fc18101 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.809115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162e56-2c08-46f5-ac94-461e5fc18101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.874850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2d162e56-2c08-46f5-ac94-461e5fc18101 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:34.876055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2d162e56-2c08-46f5-ac94-461e5fc18101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:34.888425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:34.971276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:35.249443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.251047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.353563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6196b9-c04d-48bb-97ac-6e767b57ade0 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:35.366340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:35.428549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:35.429158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.429444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.429716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.431373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.539515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:35.540999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2804-1913-4526-af53-3239a6dc5ed0 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:35.559178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 719/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:37.766074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.766601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.766601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.768029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:37.773406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a676-f5f9-45b2-b981-598ca1df792f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.773816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a676-f5f9-45b2-b981-598ca1df792f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.774007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a676-f5f9-45b2-b981-598ca1df792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.822315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.840962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ac05a676-f5f9-45b2-b981-598ca1df792f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:37.842809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ac05a676-f5f9-45b2-b981-598ca1df792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.938679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:38.220230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.221828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.322040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb46ff-7e0a-400d-af40-784873d1ab9d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.361666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.394547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.395154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.395432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.395702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.397284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.509535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.511025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b927-541c-4dc4-80e0-4d6e736b1bb3 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.529823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 729/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:40.539614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.540172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.540172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.541563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:40.547340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4a86-38da-4989-a4e2-a86fd2e769e1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.547742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4a86-38da-4989-a4e2-a86fd2e769e1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.547904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb4a86-38da-4989-a4e2-a86fd2e769e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.613735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-42bb4a86-38da-4989-a4e2-a86fd2e769e1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:40.614951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-42bb4a86-38da-4989-a4e2-a86fd2e769e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.635181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:40.710137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:40.994527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.996068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.098064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d79a7-ea6f-4469-b1fe-097581787d54 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.118173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.171746 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.172371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.172632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.172905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.174554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.280278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.281713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb3a8d-c617-472a-ad3d-7d3fa5b2772a service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.299071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 722/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:43.266019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.266551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.266551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.267929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:43.273260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257235ad-06b0-4d3c-8822-a986e8be3a0f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.273669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257235ad-06b0-4d3c-8822-a986e8be3a0f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.273854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257235ad-06b0-4d3c-8822-a986e8be3a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.336584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:43.339384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-257235ad-06b0-4d3c-8822-a986e8be3a0f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:43.341202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-257235ad-06b0-4d3c-8822-a986e8be3a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:43.440110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:43.722622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.724152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:43.826709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b7d2c-70f6-4a75-b3df-85d3666f979f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.875547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:43.899433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.900048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.900337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.900619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.902252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:44.014096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.015549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cd9c0-58ea-47ce-924d-20a22baf9192 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.033729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 732/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:46.066411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.066944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.066944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.068302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:46.073673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6456-18bf-4501-ba56-0373f176bbd9 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.074129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6456-18bf-4501-ba56-0373f176bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.074264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd6456-18bf-4501-ba56-0373f176bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.144127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-18fd6456-18bf-4501-ba56-0373f176bbd9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:46.145342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-18fd6456-18bf-4501-ba56-0373f176bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.175267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.243766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:46.527456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.529633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.631633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a851248-d3bd-4725-ac88-7fdc1585e9e4 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.660052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.704555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.705161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.705442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.705719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.707349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.814764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.816225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e05c3-5b84-452a-a7a2-9d1ec5d8e5f0 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.834222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 725/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:48.885023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.885544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.885544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.886909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:48.892166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960d3e-f27d-4b28-af25-12d10f357ac6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.892606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960d3e-f27d-4b28-af25-12d10f357ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.892739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960d3e-f27d-4b28-af25-12d10f357ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.958387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-40960d3e-f27d-4b28-af25-12d10f357ac6 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:48.959605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-40960d3e-f27d-4b28-af25-12d10f357ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:48.968137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.055991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.342825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.344369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.447294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f47c33-ba49-4e68-99b7-ae73077885fc None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.502047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.520448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.521086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.521372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.521652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.523308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.632376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.633739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854d7d4-d069-478b-a5ba-b2ac1bbe2e63 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.651440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 735/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:51.595088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.595584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.595679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.597010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:51.602279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbf26-f415-4d27-b61f-784aa2862948 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.602687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbf26-f415-4d27-b61f-784aa2862948 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.602828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbf26-f415-4d27-b61f-784aa2862948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.667963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d69bbf26-f415-4d27-b61f-784aa2862948 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:51.669702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d69bbf26-f415-4d27-b61f-784aa2862948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.707806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.765528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:52.050604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.052229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.157424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0695a-f82a-4308-996b-c0067bc99693 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.195114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:52.232571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.233185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.233470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.233747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.235390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.345313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.346715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e118c9e-1a97-4c6c-bd22-5304a5145721 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.364401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 728/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:54.258272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.258797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.258797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.260156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:54.265652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e042-be17-41e6-aa10-5f2bd5fbbaac None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.266094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e042-be17-41e6-aa10-5f2bd5fbbaac None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.266240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e042-be17-41e6-aa10-5f2bd5fbbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.331189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-eb84e042-be17-41e6-aa10-5f2bd5fbbaac None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:54.332382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eb84e042-be17-41e6-aa10-5f2bd5fbbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.350561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.428879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:54.708755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.710318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.812860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fd552-3598-48a5-a6e6-4d5d4182dda8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.878879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.886417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.887031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.887314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.887591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.889820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.997492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.998965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005026-57c9-42b1-93b7-baa25bee4c03 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.016521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 738/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:56.921699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d643f7-840a-41b9-b055-644b234254ea None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.922288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d643f7-840a-41b9-b055-644b234254ea None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.922288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d643f7-840a-41b9-b055-644b234254ea None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.923649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:46:56.928982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd04b-e6b0-4a97-8a36-33388d14c6a3 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.929386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd04b-e6b0-4a97-8a36-33388d14c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.929608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd04b-e6b0-4a97-8a36-33388d14c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.995711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-413fd04b-e6b0-4a97-8a36-33388d14c6a3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.996923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-413fd04b-e6b0-4a97-8a36-33388d14c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.044792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.094587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:57.376604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d643f7-840a-41b9-b055-644b234254ea None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.378194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-01d643f7-840a-41b9-b055-644b234254ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.480880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d643f7-840a-41b9-b055-644b234254ea None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.527797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.554369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.554985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.555268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.555547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.557149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.665340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.666767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517ca9d-e154-4d8b-ac38-118e7fc8eb5b service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.685575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 731/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:07.092687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=22 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:07.682729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=66 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.770486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6fa9-4844-4397-a253-9bcaa993af93 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:17.771030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6fa9-4844-4397-a253-9bcaa993af93 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:17.771150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6fa9-4844-4397-a253-9bcaa993af93 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:17.772416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 740/1471] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:17.777683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922196-d06d-4f64-8163-760f359a6b7e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:17.778130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922196-d06d-4f64-8163-760f359a6b7e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:17.778283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922196-d06d-4f64-8163-760f359a6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:17.843247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-94922196-d06d-4f64-8163-760f359a6b7e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:17.844461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-94922196-d06d-4f64-8163-760f359a6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:17.939148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 732/1472] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:18.232572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:18.232858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:18.233133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:18.234499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 741/1473] 10.222.0.61 () {54 vars in 967 bytes} [Wed Aug 24 05:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:18.239169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15cc95-3273-4ce5-b04a-1e8a95018ccf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:18.239480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15cc95-3273-4ce5-b04a-1e8a95018ccf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:18.239760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15cc95-3273-4ce5-b04a-1e8a95018ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:18.313754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1f15cc95-3273-4ce5-b04a-1e8a95018ccf None None] MFA Rules not processed for user `0ff470a005324829a2d9ada970436094`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:18.314986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1f15cc95-3273-4ce5-b04a-1e8a95018ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:18.335647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:18.393509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 733/1474] 10.222.0.61 () {58 vars in 1064 bytes} [Wed Aug 24 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:18.401018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:18.402647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:18.505665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447faa2-3abb-4c52-855c-b3e517baed00 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:18.577942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:18.578552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:18.578831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:18.579105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:18.580723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:18.635207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:18.689504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:18.690967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bfc40-3ab5-432b-b550-22987c4510c7 service glance] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:18.708778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 742/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:20.669521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:20.670072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:20.670072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:20.671455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 734/1476] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:20.676668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448224e1-cec7-4241-87bb-2f71f3637205 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:20.677084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448224e1-cec7-4241-87bb-2f71f3637205 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:20.677308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448224e1-cec7-4241-87bb-2f71f3637205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:20.742323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-448224e1-cec7-4241-87bb-2f71f3637205 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:20.743555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-448224e1-cec7-4241-87bb-2f71f3637205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:20.840349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 743/1477] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:21.113083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:21.114577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:21.239456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27410-d186-46aa-9f3e-bc7c70cadc96 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:21.288156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:21.334211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:21.334819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:21.335355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:21.335624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:21.336260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:21.338068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:47:21.338068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:47:21.338068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:47:21.339199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800739cd-bba7-4c64-b842-2df744266fd3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:21.357895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 735/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Wed Aug 24 05:47:21 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:23.270960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.271529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.271529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.272858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 744/1479] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:23.278275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ece8-8d76-4d8a-8818-95fa02325d86 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.278694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ece8-8d76-4d8a-8818-95fa02325d86 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.278844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ece8-8d76-4d8a-8818-95fa02325d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.343772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7bd5ece8-8d76-4d8a-8818-95fa02325d86 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.345048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7bd5ece8-8d76-4d8a-8818-95fa02325d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.439094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 736/1480] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:23.737907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.739442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.749382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.883260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad1e98-b606-4f05-bb68-dfc461ccc230 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.960590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.993905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.994512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.994792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.995065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.996640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.083957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.085824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a980-7cac-4052-b28b-59d624962871 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.103336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 745/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:26.230999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.231519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.231634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.232957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 737/1482] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:26.238477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03500b9-427c-47d3-8fbe-f369fca9b1fb None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.238915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03500b9-427c-47d3-8fbe-f369fca9b1fb None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.239012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03500b9-427c-47d3-8fbe-f369fca9b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.303146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d03500b9-427c-47d3-8fbe-f369fca9b1fb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:26.304260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d03500b9-427c-47d3-8fbe-f369fca9b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.349205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:26.400519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 746/1483] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:26.687904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:26.689445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:26.713053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:26.794994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a941cc-68f1-4fc0-b0b8-9f4abaa1e3d7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:26.871597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:26.872762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:26.873044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:26.873319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:26.874973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:27.067931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:27.103696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:27.105146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d64b-5107-49d1-9de0-25d6dfb6f269 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:27.123999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 738/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:29.051385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.051929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.051929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.053315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 747/1485] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:29.058451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47b27-c301-469d-bc5d-b64a521f1940 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.058840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47b27-c301-469d-bc5d-b64a521f1940 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.058999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47b27-c301-469d-bc5d-b64a521f1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.124796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-58d47b27-c301-469d-bc5d-b64a521f1940 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:29.126044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-58d47b27-c301-469d-bc5d-b64a521f1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.222982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 739/1486] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:29.512866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.514495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.618467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ceb7-4ca9-4f06-a2bf-d194c323a44b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.691409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:29.693339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.694023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.694675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.695018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.697167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.806089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.807556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999fb31-cbf8-40a5-8e4a-c0f1125ac52d service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.945062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 748/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:31.931380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:31.931941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:31.931941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:31.933293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 740/1488] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:31.939031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786990-30da-40e4-8f75-143dabb8e7f4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:31.939475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786990-30da-40e4-8f75-143dabb8e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:31.939626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786990-30da-40e4-8f75-143dabb8e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:32.004940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-03786990-30da-40e4-8f75-143dabb8e7f4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:32.006173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-03786990-30da-40e4-8f75-143dabb8e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:32.057955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:32.101932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 749/1489] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:32.398791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:32.400342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:32.436180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:32.502843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471d755-5852-4834-8838-18d6d79e27ba None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:32.575618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:32.576223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:32.576503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:32.576775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:32.578394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:32.656509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:32.686144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:32.687573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca679c6d-8eba-4ee7-80df-a0c4fcad23e2 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:32.705799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 741/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:34.749138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:34.749714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:34.749714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:34.751039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 750/1491] 10.222.0.61 () {54 vars in 927 bytes} [Wed Aug 24 05:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:47:34.756481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149f9d-029e-41e7-808e-6f5c754b4f94 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:34.756916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149f9d-029e-41e7-808e-6f5c754b4f94 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:34.757025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149f9d-029e-41e7-808e-6f5c754b4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:34.821811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d8149f9d-029e-41e7-808e-6f5c754b4f94 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:34.822972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d8149f9d-029e-41e7-808e-6f5c754b4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:34.919407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 742/1492] 10.222.0.61 () {58 vars in 1024 bytes} [Wed Aug 24 05:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:35.207298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:35.208859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:35.309582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bebbbe-06f1-4675-b910-37f9a4f343c9 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:35.381348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:35.381971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:35.382253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:35.382524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:35.384096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:35.392783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:35.493060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:35.494512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb785-ef84-404d-b5a5-63d15528c3e9 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:35.511723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 751/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:44.916982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=82 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:45.509499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=50 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:52.753454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.754063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.754063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.829650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:52.830810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:52.925805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 743/1494] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:52.934463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.934979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.935077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.008239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:53.010057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.105215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 752/1495] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:53.109822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.111041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.122820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714d00-9f53-4e54-8ebc-529960f24107 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:53.185251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:53.221050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:53.221666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:53.221977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:53.222253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.222889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:48:53.223189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:53.224190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:53.224190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:48:53.224190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:48:53.225063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:53.236706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 744/1496] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:48:53.246320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.255329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57aba5-3475-4d67-ba81-fda355872f0b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:53.315650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:53.350188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:53.350792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:53.351075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:53.351344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.351960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:53.353694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:53.353694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:48:53.353694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:48:53.354901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:53.409472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 753/1497] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:53 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:53.413662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.415218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.447973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421921f8-a17a-4dd8-890b-7759db70714c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:53.541994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:53.542612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:53.542896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:53.543169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.543833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:53.544870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:53.544870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:48:53.544870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:48:53.546121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:53.591229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 745/1498] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:53 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:48:53.595494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.597075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.657903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab55c53-5e3d-48fa-a5ce-af3e13e492f8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:53.743404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:53.754913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:53.755524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:53.755803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:53.756070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.756752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:53.757821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:53.757821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:48:53.757821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:48:53.759290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:53.771443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 754/1499] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:53.775643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.777155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.788310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40428e-d609-4c51-a36c-cc08346adccb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:53.813042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:53.882474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:53.883081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:53.883935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:53.884207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:53.884845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:53.885873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:53.885873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:48:53.885873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:48:53.886747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8dfe-3208-4d2d-8820-818f581e4c20 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:53.899194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 746/1500] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:53.903284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:53.904842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:53.937348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2431-115c-4d8b-8983-e251ac3face6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:54.029945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:54.030626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.030909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.031187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] PATH_INFO: `/v3/projects/1692d320a89a410b9b4dc212d08fd610/users/b9e6cf39c837490e96d2f6bf731cf80b/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.052951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1692d320a89a410b9b4dc212d08fd610, user_id=b9e6cf39c837490e96d2f6bf731cf80b, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:54.054014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:54.054014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:48:54.054014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:48:54.056618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b8251-01c5-4222-ac40-a59c5aad9dda admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:54.081142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 755/1501] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:53 2022] PUT /identity/v3/projects/1692d320a89a410b9b4dc212d08fd610/users/b9e6cf39c837490e96d2f6bf731cf80b/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:54.093525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c223-8cc1-479b-8e67-a0d127158f1c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.093846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c223-8cc1-479b-8e67-a0d127158f1c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.094129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c223-8cc1-479b-8e67-a0d127158f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.149733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3937c223-8cc1-479b-8e67-a0d127158f1c None None] MFA Rules not processed for user `b9e6cf39c837490e96d2f6bf731cf80b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:54.150969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3937c223-8cc1-479b-8e67-a0d127158f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:54.228627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 747/1502] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:48:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:54.241599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.241923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.242205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.244221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 756/1503] 10.222.0.61 () {54 vars in 964 bytes} [Wed Aug 24 05:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:48:54.248849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2bdea-fac6-4e0d-9671-ee8607b544a2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.249139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2bdea-fac6-4e0d-9671-ee8607b544a2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.249416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2bdea-fac6-4e0d-9671-ee8607b544a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.279484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:54.325618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b6c2bdea-fac6-4e0d-9671-ee8607b544a2 None None] MFA Rules not processed for user `6ccf6d1dd8cc49b385c569206fcfdbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:54.326780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b6c2bdea-fac6-4e0d-9671-ee8607b544a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:54.403099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 748/1504] 10.222.0.61 () {58 vars in 1061 bytes} [Wed Aug 24 05:48:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:54.410927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:54.412469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:54.462478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:54.516659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1df8-147f-4b47-8362-793e9fb59040 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:54.591134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:54.591675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.591961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.592241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.593917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:54.691375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:54.692804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:54.696301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:54.712403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 757/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:54.756459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d811dc-cb36-4805-ac83-e1c759132815 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.756754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d811dc-cb36-4805-ac83-e1c759132815 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.757057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d811dc-cb36-4805-ac83-e1c759132815 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.758401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 749/1506] 10.222.0.61 () {52 vars in 830 bytes} [Wed Aug 24 05:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:48:54.762427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:54.763646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:54.862387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6a77-0912-4d0c-b9a4-55868d1dd377 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:54.956635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:54.957584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:54.957820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:54.958103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] PATH_INFO: `/v3/users/b9e6cf39c837490e96d2f6bf731cf80b` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:54.970733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e6cf39c837490e96d2f6bf731cf80b)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:54.971762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:54.971762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:48:54.971762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:48:54.972984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:54.982556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:55.046137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e6cf39c837490e96d2f6bf731cf80b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:55.046680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e6cf39c837490e96d2f6bf731cf80b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:55.072725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e6cf39c837490e96d2f6bf731cf80b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:55.073193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e6cf39c837490e96d2f6bf731cf80b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:55.082151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e6cf39c837490e96d2f6bf731cf80b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:55.101489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 758/1507] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:54 2022] DELETE /identity/v3/users/b9e6cf39c837490e96d2f6bf731cf80b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:55.106098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:55.106612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:55.106706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:55.162578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:55.163707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:55.239635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:55.253512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 750/1508] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:55.263641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:55.264881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:55.364973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e4bc0-ea09-4a7e-a219-b36939f8fb40 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:55.421029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:55.441176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:55.441845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:55.442131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:55.442408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:55.444001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:55.550388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:55.551841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9646309-10ec-4211-b55d-b77e03d0e7b5 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:55.570590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 759/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:55.916788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:55.918087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:55.929291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679e486-f0dc-431f-b304-1a39ec0b2463 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:56.028523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:56.029155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:56.029432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:56.029699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] PATH_INFO: `/v3/projects/1692d320a89a410b9b4dc212d08fd610` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:56.039587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1692d320a89a410b9b4dc212d08fd610)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:56.040645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:48:56.040645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:48:56.040645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:48:56.041874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:56.098288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1692d320a89a410b9b4dc212d08fd610', 'request_id': 'req-04aea5e2-422e-4132-8e79-d88e32b3fb4f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:56.112946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1692d320a89a410b9b4dc212d08fd610', 'request_id': 'req-04aea5e2-422e-4132-8e79-d88e32b3fb4f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:56.119645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1692d320a89a410b9b4dc212d08fd610', 'request_id': 'req-04aea5e2-422e-4132-8e79-d88e32b3fb4f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:56.146030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] The token cache is being invalidate because project 1692d320a89a410b9b4dc212d08fd610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:56.146313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:56.146745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-04aea5e2-422e-4132-8e79-d88e32b3fb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:56.148143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 751/1510] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:55 2022] DELETE /identity/v3/projects/1692d320a89a410b9b4dc212d08fd610 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:49:05.568243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=62 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:06.143930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:27.891882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:27.892510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:27.892510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:27.893971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:27.900682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5045d9-1a83-4d5f-9dfe-48c2f4849de7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:27.901356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5045d9-1a83-4d5f-9dfe-48c2f4849de7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:27.901576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5045d9-1a83-4d5f-9dfe-48c2f4849de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:27.998689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0d5045d9-1a83-4d5f-9dfe-48c2f4849de7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:27.999952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0d5045d9-1a83-4d5f-9dfe-48c2f4849de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:28.142667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:28.423165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:28.425874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:28.635803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b8d15-b508-46fa-b0bd-4e5f78409f3e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:28.641939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:28.642710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:28.643102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:28.643472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:28.654805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:28.656649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a186-627c-4d25-9274-ec8f4f7358d2 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:28.668758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 761/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:29.625754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b7b4-a1a1-406d-b9c4-80387cbb5067 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:29.626526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b7b4-a1a1-406d-b9c4-80387cbb5067 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:29.626526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b7b4-a1a1-406d-b9c4-80387cbb5067 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:29.628108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:50:29.634344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188376-bd8a-4717-b22b-0593b9fe81b8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:29.634973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188376-bd8a-4717-b22b-0593b9fe81b8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:29.634973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d188376-bd8a-4717-b22b-0593b9fe81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:29.656997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7d188376-bd8a-4717-b22b-0593b9fe81b8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:29.658282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7d188376-bd8a-4717-b22b-0593b9fe81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:29.667812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:50:29.837191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4b7b4-a1a1-406d-b9c4-80387cbb5067 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:29.852502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4b7b4-a1a1-406d-b9c4-80387cbb5067 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:29.858211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:29.858837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:29.859127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:29.859408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:29.868591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:29.870406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f5ee8-7a87-40a0-8564-a0308fe025f3 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:29.888931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 754/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:30.579216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0698-474e-46e9-9268-d6ac79a50fb4 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:30.579495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0698-474e-46e9-9268-d6ac79a50fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:30.579794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0698-474e-46e9-9268-d6ac79a50fb4 None None] PATH_INFO: `/v3` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:30.581076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 763/1517] 10.222.0.42 () {54 vars in 925 bytes} [Wed Aug 24 05:50:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:50:30.587364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e3b2-41c3-4f00-8fe4-d09f1dae5dfc None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:30.587656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e3b2-41c3-4f00-8fe4-d09f1dae5dfc None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:30.587931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e3b2-41c3-4f00-8fe4-d09f1dae5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:30.648832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8527e3b2-41c3-4f00-8fe4-d09f1dae5dfc None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:30.650091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8527e3b2-41c3-4f00-8fe4-d09f1dae5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:30.667737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:30.731048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 755/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 05:50:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:34.560788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb126942-3a82-4b67-9ed1-2d9cafa825e0 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:34.561246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb126942-3a82-4b67-9ed1-2d9cafa825e0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:34.561350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb126942-3a82-4b67-9ed1-2d9cafa825e0 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:34.562701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 764/1519] 10.222.0.61 () {54 vars in 961 bytes} [Wed Aug 24 05:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:34.568640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b0dd-2a55-4ac9-896a-026638735708 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:34.569146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b0dd-2a55-4ac9-896a-026638735708 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:34.569255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b0dd-2a55-4ac9-896a-026638735708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:34.589999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-69d1b0dd-2a55-4ac9-896a-026638735708 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:34.591217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-69d1b0dd-2a55-4ac9-896a-026638735708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:34.599776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 756/1520] 10.222.0.61 () {58 vars in 1058 bytes} [Wed Aug 24 05:50:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:34.607619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb126942-3a82-4b67-9ed1-2d9cafa825e0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:34.622538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb126942-3a82-4b67-9ed1-2d9cafa825e0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:34.627608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:34.628226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:34.628510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:34.628786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:34.638166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:34.639773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948555-534b-41df-abbf-b3c00f75b65d service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:34.650453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 765/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:41.129596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff6a7-fb0d-4c5a-a9d0-9c3c83c0ba42 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:41.130179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff6a7-fb0d-4c5a-a9d0-9c3c83c0ba42 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:41.130332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff6a7-fb0d-4c5a-a9d0-9c3c83c0ba42 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:41.132238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:41.136927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef282-ebd8-4933-9789-66f493b96554 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:41.137367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef282-ebd8-4933-9789-66f493b96554 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:41.137467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef282-ebd8-4933-9789-66f493b96554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:41.157185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-40eef282-ebd8-4933-9789-66f493b96554 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:41.158417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-40eef282-ebd8-4933-9789-66f493b96554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:41.166345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:41.320010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ff6a7-fb0d-4c5a-a9d0-9c3c83c0ba42 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:41.335499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ff6a7-fb0d-4c5a-a9d0-9c3c83c0ba42 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:41.340861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:41.341454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:41.341737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:41.342040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:41.350416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:41.351976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730f4e-3f72-4b9c-9601-e6dace4e06a5 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:41.361219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 758/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:42.176763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5312fc-ec85-4ec2-bd43-7c02746793bb None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:42.177902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5312fc-ec85-4ec2-bd43-7c02746793bb None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:42.177902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5312fc-ec85-4ec2-bd43-7c02746793bb None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:42.179268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:42.184090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e529e-be29-46e6-880d-8b7b75cee199 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:42.184471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e529e-be29-46e6-880d-8b7b75cee199 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:42.184641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e529e-be29-46e6-880d-8b7b75cee199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:42.204247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-181e529e-be29-46e6-880d-8b7b75cee199 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:42.205460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-181e529e-be29-46e6-880d-8b7b75cee199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:42.213401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:42.365506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5312fc-ec85-4ec2-bd43-7c02746793bb None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:42.379952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5312fc-ec85-4ec2-bd43-7c02746793bb None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:42.385544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:42.386187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:42.386474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:42.386757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:42.394712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:42.396811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc5ac7-582f-4505-9ced-0ffa3ef2234f service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:42.406142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 768/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:46.674381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:46.674928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:46.674928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:46.676273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:46.681539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d488-231d-4989-a596-46c9445b1e6f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:46.681974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d488-231d-4989-a596-46c9445b1e6f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:46.682153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d488-231d-4989-a596-46c9445b1e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:46.701505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7018d488-231d-4989-a596-46c9445b1e6f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:46.702752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7018d488-231d-4989-a596-46c9445b1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:46.711648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:47.007286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:47.009061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:47.087947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5476-30a7-42bc-b91e-1935782e2cdd None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:47.091536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:47.092138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:47.092421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:47.092696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:47.101439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:47.103015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6e979-f92d-47f0-8531-d4cb39d16f0b service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:47.112338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 761/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:49.001585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294aee-3ab3-4c12-b3ef-1ff4af83ed29 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:49.002112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294aee-3ab3-4c12-b3ef-1ff4af83ed29 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:49.002112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294aee-3ab3-4c12-b3ef-1ff4af83ed29 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:49.003454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:49.008635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd47a3-5b3d-4360-961a-6af0df4c7dd1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:49.009057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd47a3-5b3d-4360-961a-6af0df4c7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:49.009278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd47a3-5b3d-4360-961a-6af0df4c7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:49.028404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e6bd47a3-5b3d-4360-961a-6af0df4c7dd1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:49.029734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e6bd47a3-5b3d-4360-961a-6af0df4c7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:49.037936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:49.321383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63294aee-3ab3-4c12-b3ef-1ff4af83ed29 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:49.332318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63294aee-3ab3-4c12-b3ef-1ff4af83ed29 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:49.336296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:49.336890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:49.337176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:49.337454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:49.346137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:49.347631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb50a-ba34-4719-a7f2-ec20a4ef9c6c service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:49.357480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 771/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:52.812223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:52.812782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:52.812782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:52.814118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:52.819477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae44-9fa8-443e-8d67-cb6e52ce8cbc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:52.819925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae44-9fa8-443e-8d67-cb6e52ce8cbc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:52.820032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae44-9fa8-443e-8d67-cb6e52ce8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:52.840249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-4ba4ae44-9fa8-443e-8d67-cb6e52ce8cbc None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:52.841443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4ba4ae44-9fa8-443e-8d67-cb6e52ce8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:52.849794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:53.396205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:53.397958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:53.473154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:53.486885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e310cd-3a16-4fdc-966e-701ee3071dbe None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:53.492230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:53.492624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:53.492905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:53.493179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:53.501984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:53.503400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7ae7-738c-431b-a162-dd5ab109ff4f service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:53.512900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 764/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:55.441319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:55.441923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:55.441923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:55.444053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:50:55.449461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022fda-336e-43f1-b923-a0e2b3137c31 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:55.449920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022fda-336e-43f1-b923-a0e2b3137c31 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:55.450073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022fda-336e-43f1-b923-a0e2b3137c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:55.470146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1e022fda-336e-43f1-b923-a0e2b3137c31 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:55.471338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1e022fda-336e-43f1-b923-a0e2b3137c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:55.479287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:56.025666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:56.027370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:56.034838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=84 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:56.041287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5e650-f8d0-44a2-be12-24587e443a7a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:56.044746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:56.045399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:56.045684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:56.045989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:56.054704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:56.056213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df49c34-c897-42aa-aea0-db0d8bad1b56 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:56.065408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 774/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:05.465364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=11 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:06.061295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:22.013971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.014667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.014667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.041088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.042510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.054062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 766/1540] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:22.063684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.064231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.064231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.089930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.091339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.104500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 775/1541] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.110298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.123422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9d8b-414f-455c-a52a-0e16ee6ae8ef None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.129329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.130020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.130310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.130592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.131267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:22.131574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.133185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.149414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 767/1542] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:22.158702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.171237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10594-3259-423f-80f1-d46a96e58e24 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.179568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.180207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.180495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.180776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.181433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.183508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5be11-2cf0-4fd2-9435-e4665c3e8d08 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.255494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 776/1543] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:22.260414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.283213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763ad4-776d-4aaf-9aa4-d93886d72be7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.356480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.357127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.357464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.357830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.358555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.362000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.385530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadb9-7797-4a1c-8657-3476179a63ee None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.386006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadb9-7797-4a1c-8657-3476179a63ee None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.386291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadb9-7797-4a1c-8657-3476179a63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.417600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 768/1544] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:52:22.423547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.439153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-cd1dadb9-7797-4a1c-8657-3476179a63ee None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.441859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-cd1dadb9-7797-4a1c-8657-3476179a63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.454485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9c21-d8ea-4515-924c-715de8042efd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.468296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.468934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.469795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.471406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 777/1545] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.472667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027be9-79d7-4819-9843-e7a2006fdbeb None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.472948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027be9-79d7-4819-9843-e7a2006fdbeb None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.473229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027be9-79d7-4819-9843-e7a2006fdbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.474189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.474969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.476977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.498462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 769/1546] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:22.499485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.503119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c4027be9-79d7-4819-9843-e7a2006fdbeb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.504358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c4027be9-79d7-4819-9843-e7a2006fdbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.511815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b288-fed9-409a-b2ad-319719b59434 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.529097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.529728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.530056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.531989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 778/1547] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.532526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.533815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.534048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.534320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.537383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.543953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f001e0-bf42-401c-bb1d-bd170eda3f99 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.560975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 770/1548] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:22.562107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ff0-5d05-4878-b3f4-88f2fff5737f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.562552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ff0-5d05-4878-b3f4-88f2fff5737f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.563390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ff0-5d05-4878-b3f4-88f2fff5737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.584679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.586090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.595082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 779/1549] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.595884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.609563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe477865-03fb-4df2-9c18-8a7bcd0f0d56 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.611232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d0b08ff0-5d05-4878-b3f4-88f2fff5737f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.612723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d0b08ff0-5d05-4878-b3f4-88f2fff5737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.615903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.615903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.616173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.616388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] PATH_INFO: `/v3/projects/7500f04f4b4641ee9a9c86ae3494695a/users/4c62008668ca423dab42c576bb735b70/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.630260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 771/1550] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.632014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.632515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.633033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.634256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7500f04f4b4641ee9a9c86ae3494695a, user_id=4c62008668ca423dab42c576bb735b70, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.641327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.664778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 780/1551] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:22 2022] PUT /identity/v3/projects/7500f04f4b4641ee9a9c86ae3494695a/users/4c62008668ca423dab42c576bb735b70/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:22.667808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.686891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.688998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.753688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d3f1-b47a-4422-b21a-c8def12124fc admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.758693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.759305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.759588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.759862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.760506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:22.760809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.761845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:22.761845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:52:22.761845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:52:22.762727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109bd9a-1708-4533-91d9-afd21d49b6c0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.763589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 772/1552] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.764507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.774210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0e904-e0fb-4291-bfe2-512e9404d0a4 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.775149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 781/1553] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:22.776247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10139-aff1-4888-b37d-a2acf50cad0a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.776533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10139-aff1-4888-b37d-a2acf50cad0a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.776809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10139-aff1-4888-b37d-a2acf50cad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.779027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.779681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.779919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.780194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.780840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:22.781148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.783663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20443855-194f-43f5-a99e-6bc2010a6fbc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.795628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 773/1554] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:22.796653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2b24-8082-436f-845f-e56184e869a1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.796939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2b24-8082-436f-845f-e56184e869a1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.797822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2b24-8082-436f-845f-e56184e869a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.802832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-efe10139-aff1-4888-b37d-a2acf50cad0a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.804298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-efe10139-aff1-4888-b37d-a2acf50cad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.812145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 782/1555] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.813437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5520-a300-4c6f-8679-9371625962f3 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.813724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5520-a300-4c6f-8679-9371625962f3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.814024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5520-a300-4c6f-8679-9371625962f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.817467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-059f2b24-8082-436f-845f-e56184e869a1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.818770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-059f2b24-8082-436f-845f-e56184e869a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.827117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 774/1556] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.828314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bdfa-8516-4154-9ce7-1fe89b4039b2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.829639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bdfa-8516-4154-9ce7-1fe89b4039b2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.829639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bdfa-8516-4154-9ce7-1fe89b4039b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.835227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a9cf5520-a300-4c6f-8679-9371625962f3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.836595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a9cf5520-a300-4c6f-8679-9371625962f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.845279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 783/1557] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.846530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.846961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.847361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.849113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b9f1bdfa-8516-4154-9ce7-1fe89b4039b2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.850382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b9f1bdfa-8516-4154-9ce7-1fe89b4039b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.858174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 775/1558] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.859369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.859683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.859956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.867402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.868618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.876824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 784/1559] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.877598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.879606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.880782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.887589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac166-681f-47e3-ab90-10583ab2d199 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.890202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 776/1560] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:22.891547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.895751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.896348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.896630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.896906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.897532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.899539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.901080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d23ad-a2a0-4924-a7ae-ce1f8ff24313 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:22.905571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:22.906198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.906477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.907304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.907963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:22.908960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:22.908960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:52:22.908960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:52:22.910155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5331-6f42-4102-85a9-a99d61aadb6c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:22.915656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:22.928748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 785/1561] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:22.929908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:22.939242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 777/1562] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:22.940679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a04a-200c-42f0-99d7-f49f7b23623f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:22.940972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a04a-200c-42f0-99d7-f49f7b23623f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:22.941248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a04a-200c-42f0-99d7-f49f7b23623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:22.961237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0541a04a-200c-42f0-99d7-f49f7b23623f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:22.962460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0541a04a-200c-42f0-99d7-f49f7b23623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:22.967110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:22.990785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c83a9-b89b-4a7d-8ce6-2eb335e0f407 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.025022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 778/1563] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:23.025022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f1ba-c189-406a-b07c-27b687f76567 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.025022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f1ba-c189-406a-b07c-27b687f76567 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.025022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f1ba-c189-406a-b07c-27b687f76567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.040692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.041333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.041679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.041917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.042552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-da01f1ba-c189-406a-b07c-27b687f76567 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:23.043756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-da01f1ba-c189-406a-b07c-27b687f76567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.050928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.051565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 779/1564] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:23.052279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580e13-afd1-47f2-9d80-5f88211ff8cb service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.052828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.053120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.053401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.061978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 786/1565] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:23.063227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.063578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.063859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.074100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:23.076006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.084014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:23.085366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:23.086101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 780/1566] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:23.087127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.095653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 787/1567] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:23.096440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.098143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1f04-fbb5-4498-aa9a-b5f4ba794c5a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.103557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.104242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.104517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.104793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.105446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:23.105789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.106573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54821c-99ec-485c-ae51-c16612cd1946 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.107415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.111787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.112404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.112748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.113034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.113795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.114894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:23.114894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:52:23.114894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:52:23.116183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.120985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 781/1568] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:23.122021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.139167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149118-5b5e-47ec-84b0-f06c5f8388e7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.147891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 788/1569] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.147891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.148952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.149893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.150333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.150616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.151264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.153369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.158430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228da5d-1944-4b49-a124-4c4d8ac98420 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.164043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.165222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.166020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.166522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.167327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:23.167695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.169947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.178645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 782/1570] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.179817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.191791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3d02-8aff-46a5-8bf4-da38711d6cdb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.197324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.198090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.198285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 789/1571] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:23.198474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.198822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.199276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.199465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:23.199811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.201822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.212959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dc8-5cec-48b2-8c7d-8b8084c39dd3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.223127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 783/1572] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:23.223127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.226827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.227328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.227615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.227945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.229154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:23.229501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.231945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.237153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82037b-ed18-4f75-851c-56cb2c4c326f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.244907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.245927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.246060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 790/1573] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:23.246685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.253684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.254200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.255082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:23.255467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.257362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.262298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409fc6-3681-4c67-acdd-71f4087bdfb3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.271078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 784/1574] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:23.275813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.278664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.280855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.281323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.282501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.284175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.286332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.288997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99573e24-5c9f-4fb8-89cb-478784313492 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.294242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.294859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.295149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.295431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.296080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.298317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.313335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 785/1575] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:23.314303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.322035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 791/1576] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.323257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.326799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed61ab-4d25-43ce-92e8-d53961fd253d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.395671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.396541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c85a9-9b71-470b-97d2-0a1bc2281408 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.396873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.397347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.397924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.399184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.401579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.402490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.403215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.403754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.404241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.405103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.408220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.416256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 786/1577] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:23.417394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.423998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:23.430403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc55f-c3d2-43d3-8485-7d82740cb08d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.436811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.437240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.437535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.438380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.439639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.442575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.463483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 792/1578] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.464648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.471292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:23.477392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 787/1579] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.478470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.551871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627ffb9-01f0-4eed-85c7-f936ffd21d07 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.557996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.558505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103addf-a729-48d5-989a-94f4b5468525 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.558844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.559247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.559584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.560337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.562485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.564027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.564767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.565133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.565516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.566747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.568769 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.600242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 788/1580] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.602755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.605141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 793/1581] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.606251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.680328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd80b-05b5-47fa-abce-c8417671db02 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.680516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772955a-2e20-47c2-9238-6614181fa702 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.684918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.685153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.685558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.685871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.685979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.686141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.686413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.686767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.686870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.687500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.688705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.689317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.703894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 789/1582] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:23.703894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.715720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e551-f83a-4277-99f4-fa974db6796c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.722822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 794/1583] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.722822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.725344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.726197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.726686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.727004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.727869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.730315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.731443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098971-0f78-4c3c-a9ba-8de6870d1dbe admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.737714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.738528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.738810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.739083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.741478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.742243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.744488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 790/1584] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:23.746282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.757160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033b05-c546-42dd-a8cf-f4aca6ede954 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.764848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.765479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.767151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.767447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.768094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.770236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.773292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 795/1585] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.774387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.787001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479459-170d-4c33-850e-2d46573a8b13 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.792274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.793137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.793307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.793544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.794240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.796133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.800445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 791/1586] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 303 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.800445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.813315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8030-8fa2-484c-b229-24daf7480bf8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.820739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.821439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.821837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.822207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.822943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.825230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.839209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 796/1587] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.840317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.850676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 792/1588] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:23 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:23.851883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.857677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2f47-520b-49d8-a223-24229b60799d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.863615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.864253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.864566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.864840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] PATH_INFO: `/v3/projects/394bd146ed3940ef94adb458c5a49c80/users/757b14b86ca1417996c353b423b27b55/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.870289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c517cf2-2d76-4172-b8a1-0d81ac5e0126 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.877540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:23.878329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:23.878886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:23.879175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:23.879846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.883292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.884691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394bd146ed3940ef94adb458c5a49c80, user_id=757b14b86ca1417996c353b423b27b55, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:23.887707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:23.901217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 793/1589] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:23.902094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.911826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 797/1590] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:23 2022] PUT /identity/v3/projects/394bd146ed3940ef94adb458c5a49c80/users/757b14b86ca1417996c353b423b27b55/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:23.912697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:23.914829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:23.919724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b0d1-e97d-47f0-904b-0e464c94fa48 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:23.946227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.004277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.005704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.005937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.006216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] PATH_INFO: `/v3/projects/fbc1c169f2384dcba62d61a1a77f33d0/users/37d1bbd61c0c44678f27886c252d731c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.030792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc1c169f2384dcba62d61a1a77f33d0, user_id=37d1bbd61c0c44678f27886c252d731c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.034744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:24.034744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:52:24.034744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:52:24.038093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3264281-87bc-4f8c-88b8-7e6be70bdeb7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.038710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.043621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.044267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.044690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.045072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.046037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.048603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.062368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 798/1591] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.063490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 794/1592] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:23 2022] PUT /identity/v3/projects/fbc1c169f2384dcba62d61a1a77f33d0/users/37d1bbd61c0c44678f27886c252d731c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:24.066028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.070175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.084215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8bdc6-54b0-41af-80d1-ceb8b5999624 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.150819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.151444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.151768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.152047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.153224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.155290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.169931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 799/1593] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.171052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.177423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ea07-57e1-4b9f-98a4-74ce2c422273 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.183891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55faaa8-3255-41b9-a364-ce29f7ab1b81 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.184052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.184749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.185102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.185524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.186286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.188288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.188859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.189469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.189813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.190199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.191634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.193802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ca107-26fe-49ee-837b-7e43632d9932 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.204485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 795/1594] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.204485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.209589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 800/1595] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.209589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.209589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.209589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.217789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6660d6-8616-4e29-a9d5-a56bff7d0eb2 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.224166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.225364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.225758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.226172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.226940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.228950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.242195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] MFA Rules not processed for user `757b14b86ca1417996c353b423b27b55`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:24.244075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:24.246942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 796/1596] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.247986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.263441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97204-042d-44fa-b421-1c465cada3cb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.270388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.271020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.271363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.271647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.272562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.274323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cb1e-6bb2-4f15-a3b7-4f73ee52dce2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.286697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 797/1597] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.288105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.288403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.288687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.322400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] MFA Rules not processed for user `37d1bbd61c0c44678f27886c252d731c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:24.323653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:24.357714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 801/1598] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:24.358430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.372003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469cbce-11aa-4e6d-9f3e-3a32d9938890 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.378412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.379053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.379325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.379602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.381054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.383018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.406899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.413206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 802/1599] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.414845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.435882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b73c2-6591-448e-acb1-b36f9a36520c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.445586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.447199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.447464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.447801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.449577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.452389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 798/1600] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:24.455196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.459830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.476158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 803/1601] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.476158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.485795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389799-cc29-4c58-82be-86d37fb8a041 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.489119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5461aa3-83bf-4a07-924f-c3c2d0dd8ea7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.495036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.495772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.496052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.496326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.496992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.497557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.498431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.498781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.498888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.499153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] PATH_INFO: `/v3/projects/03fa94320f714ab881aa0b9d4c077d6c/users/e47e1b7589bb427aa13c27f7bc1d6d9c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.503287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.514623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 799/1602] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:24.515317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.526169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6da45-efb8-4558-8eb2-c415b7469506 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.531245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.531948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.532232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.533636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] PATH_INFO: `/v3/projects/8c0f78af99c64433afb745a0cb1d1027/users/663939b4b57d40d29961d0c82fcc562c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.540091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fa94320f714ab881aa0b9d4c077d6c, user_id=e47e1b7589bb427aa13c27f7bc1d6d9c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.542831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.549787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0f78af99c64433afb745a0cb1d1027, user_id=663939b4b57d40d29961d0c82fcc562c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.552524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.569843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 800/1603] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:24 2022] PUT /identity/v3/projects/8c0f78af99c64433afb745a0cb1d1027/users/663939b4b57d40d29961d0c82fcc562c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:24.573117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 804/1604] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:24 2022] PUT /identity/v3/projects/03fa94320f714ab881aa0b9d4c077d6c/users/e47e1b7589bb427aa13c27f7bc1d6d9c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:24.577303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.579792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.670262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217609d3-624c-49bb-ae96-63faf237a88a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.676888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0d74-eb76-4bb9-a0f0-0e66de6f8020 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.678929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.679279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.679694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.680051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.680758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.683590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.688957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.690205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.690687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.691165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] PATH_INFO: `/v3/projects/45a0a2d297884a40a13d1018ebc706fa/users/d4dd8b81c6b94eba802960e45837253b/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.713231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a0a2d297884a40a13d1018ebc706fa, user_id=d4dd8b81c6b94eba802960e45837253b, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.717328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.730821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 801/1605] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:24.731848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.737703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 805/1606] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:24 2022] PUT /identity/v3/projects/45a0a2d297884a40a13d1018ebc706fa/users/d4dd8b81c6b94eba802960e45837253b/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:24.739010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.805071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120006f-b46c-4f40-9f69-dff2295e197b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.832191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd7aa-8a6a-4081-ad3b-fbff5d6d6fff admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.838935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.839632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.839923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.840203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] PATH_INFO: `/v3/projects/2b388a89bcf642c2b5ef16ffc34b53f7/users/92ba8e92c99641cfb418266f5374f0e0/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.868730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b388a89bcf642c2b5ef16ffc34b53f7, user_id=92ba8e92c99641cfb418266f5374f0e0, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.871509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.876074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.876853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.877095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.877333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.945721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 806/1607] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:24 2022] PUT /identity/v3/projects/2b388a89bcf642c2b5ef16ffc34b53f7/users/92ba8e92c99641cfb418266f5374f0e0/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:24.945721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.946536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.990608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:25.013008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fee5a-3684-4afc-935c-0b3ec92f7c83 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.018764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.019457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.019739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.020019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] PATH_INFO: `/v3/projects/6be0774a8ec04aa7aec1fa638038c7fd/users/74a53d36cb7549479e0d4692ffde1f9e/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.027206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.028867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa1bcb-83a3-4b08-8944-9cdcac46889b service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.041666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be0774a8ec04aa7aec1fa638038c7fd, user_id=74a53d36cb7549479e0d4692ffde1f9e, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.044223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b03b0-4d33-4bf4-96df-7f25126a2b6e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.050087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 802/1608] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.051475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.051799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.052141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.065871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 807/1609] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:24 2022] PUT /identity/v3/projects/6be0774a8ec04aa7aec1fa638038c7fd/users/74a53d36cb7549479e0d4692ffde1f9e/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:25.067675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b495e-951b-4e63-94aa-351ec0724dcc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.067966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b495e-951b-4e63-94aa-351ec0724dcc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.068844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b495e-951b-4e63-94aa-351ec0724dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.072001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:25.073238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.105800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a62b495e-951b-4e63-94aa-351ec0724dcc None None] MFA Rules not processed for user `663939b4b57d40d29961d0c82fcc562c`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:25.107960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a62b495e-951b-4e63-94aa-351ec0724dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.165052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 803/1610] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:25.166292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.177851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b16a8a-3fbf-427c-af3d-56298f8fc9b2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.183125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.183752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.184038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.184317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.184965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.186952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88e1fc-6308-4c29-96d9-8da31c67f46e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.202654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 808/1611] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:25.204452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c034-ff5c-48ee-96fb-6d36bab1aeda None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.204880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c034-ff5c-48ee-96fb-6d36bab1aeda None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.205887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c034-ff5c-48ee-96fb-6d36bab1aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.218727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 804/1612] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:25.221698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.222115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.222433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.239028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b3b9c034-ff5c-48ee-96fb-6d36bab1aeda None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:25.241110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b3b9c034-ff5c-48ee-96fb-6d36bab1aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.244835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:25.246214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.256362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 809/1613] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:25.258367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.258774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.259433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.265398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 805/1614] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:25.266958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.279343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.283864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:25.285345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:25.299714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 810/1615] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:25.299714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.311008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d269a40-d33e-4fef-99ab-c6c6d3aae99a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.316921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.318230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.318580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.319199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.320456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.323116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.362576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 811/1616] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:25.363363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.383092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ca9b4-b5ec-4952-905c-c87380b0c389 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.438365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:25.455850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b49e2d-5536-4857-bcf3-a0637f28bb57 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.456367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.457297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.457535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.458790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.466939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.468006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.468372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.468721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.469571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.471342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.471585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.473285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.497826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 806/1617] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.499700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.508990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 812/1618] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:25.510387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.523976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca05d8a-b2d6-4bd8-9871-307db04a526f service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.534250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.536394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.538114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.538564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.540812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ba51-b8a4-4a42-b215-bed095d918e2 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.544932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.545543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.545865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.546804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.563311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.564861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.571333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.572871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.589041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 807/1619] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.589919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.596720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 813/1620] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.598552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.611731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969665-4062-4e31-82a6-9fd811205508 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.615360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.615989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.616278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.616553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.619603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfdb-c718-4c9d-9de8-88955a778581 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.637930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.638571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.638898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.639120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.639903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.640235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.641826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.642246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.663451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:25.671025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 808/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:25.671908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.689384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 814/1622] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:25 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:25.690294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.695935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83686914-ac1b-4240-b8ac-934ea125145f service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.707658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f528-e496-4b0e-b007-f8b930b8cbf3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.708878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.709078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.710078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.710078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] PATH_INFO: `/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda/users/f1e54c8f620f4177998d69901548a74c/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.724182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:25.724823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:25.725112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:25.725403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:25.726087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.727842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.729590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b5c7b2248942efb3fdeba210c9ecda, user_id=f1e54c8f620f4177998d69901548a74c, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:25.733451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:25.784903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 815/1623] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:25.788657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.796535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 809/1624] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:25 2022] PUT /identity/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda/users/f1e54c8f620f4177998d69901548a74c/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:25.804794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:25.840459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c0a5-e77c-4462-b309-8d3297b81de9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:25.998588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cfd0-5cf3-4bfb-aa4f-fde8f016c605 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.011239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.011899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.013908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.014222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.014914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.025512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.039686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.040468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.040759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.041035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] PATH_INFO: `/v3/projects/608dd09423414ff3ae08723c9090e619/users/2dc12fd04e034d01b65241ef8a1da599/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.057366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 810/1625] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:26.058485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:26.077879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608dd09423414ff3ae08723c9090e619, user_id=2dc12fd04e034d01b65241ef8a1da599, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.081265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.090485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515181f-61f5-468e-8b09-0ab71b73d1ba admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.116417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 816/1626] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:25 2022] PUT /identity/v3/projects/608dd09423414ff3ae08723c9090e619/users/2dc12fd04e034d01b65241ef8a1da599/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:26.119998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:26.120219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.121240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.121577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.121892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] PATH_INFO: `/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda/users/f1e54c8f620f4177998d69901548a74c/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.128311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b5c7b2248942efb3fdeba210c9ecda, user_id=f1e54c8f620f4177998d69901548a74c, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.136904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4498c-2498-4dba-a28b-7da0ca5e7007 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.176259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 811/1627] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:26 2022] PUT /identity/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda/users/f1e54c8f620f4177998d69901548a74c/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:26.187089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.188248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.188991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.257124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] MFA Rules not processed for user `f1e54c8f620f4177998d69901548a74c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:26.259318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:26.272455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fd92-d5b6-4ff9-8df0-f2274ea735e1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.419812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.420488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.420733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.421013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.421670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.423570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.446300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 817/1628] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:52:26.452701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:26.460453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 812/1629] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:26.476459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e6d38-9e7d-4527-b14b-1f24337d4646 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.476709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:26.486174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.486749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:26.486948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.487315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.487601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] PATH_INFO: `/v3/projects/608dd09423414ff3ae08723c9090e619/users/2dc12fd04e034d01b65241ef8a1da599/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.497855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=608dd09423414ff3ae08723c9090e619, user_id=2dc12fd04e034d01b65241ef8a1da599, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.501238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e000d32-c17c-4564-98b6-654560ab50ad admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.504068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:26.561067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 818/1630] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:26 2022] PUT /identity/v3/projects/608dd09423414ff3ae08723c9090e619/users/2dc12fd04e034d01b65241ef8a1da599/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:52:26.572189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.572478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.572763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.608018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be49800-5260-476b-87ca-b747fe01a7ef None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.632560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] MFA Rules not processed for user `2dc12fd04e034d01b65241ef8a1da599`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:26.633891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:26.722495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.723717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.723956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.726138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.814980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 819/1631] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:26.827504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:26.860267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907a1a-b032-4ce4-a874-4d5a9c0142bc None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:26.877255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:26.883201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:26.883666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:26.884641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:26.894684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:26.897522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:26.928613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 813/1632] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:27.053578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:27.055332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143d990-08e3-4f27-8e4f-4530371c31d2 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:27.079388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 820/1633] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:27.216877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:27.231879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b4f-b4f2-41c8-9359-515c3efef650 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:27.241224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:27.243359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:27.243774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:27.244162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:27.382845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:27.388095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3299-9cb4-48fe-a586-d65da1de9bdf service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:27.415913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 814/1634] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:27.722151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22ed7a-034b-4f75-b53f-e4113dde0a79 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:27.723011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22ed7a-034b-4f75-b53f-e4113dde0a79 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:27.723458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22ed7a-034b-4f75-b53f-e4113dde0a79 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:27.725424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 821/1635] 10.222.0.61 () {54 vars in 962 bytes} [Wed Aug 24 05:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:27.786056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:27.786789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:27.786789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:27.844190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:27.931509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:27.932764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:28.116022 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4949-6175-427c-bc02-f7719d844a20 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:28.116321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4949-6175-427c-bc02-f7719d844a20 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:28.116607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4949-6175-427c-bc02-f7719d844a20 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:28.118526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 822/1636] 10.222.0.61 () {54 vars in 912 bytes} [Wed Aug 24 05:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:52:28.122223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 815/1637] 10.222.0.61 () {58 vars in 1059 bytes} [Wed Aug 24 05:52:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:28.124410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a7bf-26ac-4a77-93ad-86ea1fe2987e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:28.124410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a7bf-26ac-4a77-93ad-86ea1fe2987e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:28.124654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a7bf-26ac-4a77-93ad-86ea1fe2987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:28.195081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3b53a7bf-26ac-4a77-93ad-86ea1fe2987e None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:28.196425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3b53a7bf-26ac-4a77-93ad-86ea1fe2987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:28.225703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:28.226360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 823/1638] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:52:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:28.238676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58c726-f5ad-4d65-829a-6336ca527c53 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:28.244433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:28.245322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:28.245714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:28.246217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:28.268520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:28.273426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef1f3-132d-4cc5-ba2e-ed3a20918303 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:28.302876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 816/1639] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:29.101898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659648-8b5d-4b0a-9e1d-681e4b8ad8be None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.102841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659648-8b5d-4b0a-9e1d-681e4b8ad8be None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.103304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659648-8b5d-4b0a-9e1d-681e4b8ad8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.170429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0f659648-8b5d-4b0a-9e1d-681e4b8ad8be None None] MFA Rules not processed for user `4c62008668ca423dab42c576bb735b70`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:29.172086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0f659648-8b5d-4b0a-9e1d-681e4b8ad8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:29.306647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:29.321360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 824/1640] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:29.336285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eee90c-f348-444e-8f1c-7c1e4a85b5d6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.337855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eee90c-f348-444e-8f1c-7c1e4a85b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.338371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eee90c-f348-444e-8f1c-7c1e4a85b5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.395075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-87eee90c-f348-444e-8f1c-7c1e4a85b5d6 None None] MFA Rules not processed for user `4c62008668ca423dab42c576bb735b70`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:29.397839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-87eee90c-f348-444e-8f1c-7c1e4a85b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:29.449407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 817/1641] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:29.499869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df239-f70b-43f9-ace9-1ada6363029d None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.500717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df239-f70b-43f9-ace9-1ada6363029d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.501187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df239-f70b-43f9-ace9-1ada6363029d None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.503190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 825/1642] 10.222.0.61 () {54 vars in 962 bytes} [Wed Aug 24 05:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:29.525602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455b91-3ada-43fc-8e91-d91f14288090 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.525951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455b91-3ada-43fc-8e91-d91f14288090 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.526810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455b91-3ada-43fc-8e91-d91f14288090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.589028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-64455b91-3ada-43fc-8e91-d91f14288090 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:29.596207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-64455b91-3ada-43fc-8e91-d91f14288090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:29.655101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 818/1643] 10.222.0.61 () {58 vars in 1059 bytes} [Wed Aug 24 05:52:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:29.672689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2df239-f70b-43f9-ace9-1ada6363029d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:29.701177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2df239-f70b-43f9-ace9-1ada6363029d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:29.753034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:29.753034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:29.753034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:29.753034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:29.756546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:29.756546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056b75f-e1ac-4e57-8dc1-11dc4498e840 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:29.807673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 826/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:30.334086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:30.334387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:30.334672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:30.344326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b60c8e-b89e-4e13-9762-660932e9f0af None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:30.344861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b60c8e-b89e-4e13-9762-660932e9f0af None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:30.345044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b60c8e-b89e-4e13-9762-660932e9f0af None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:30.346570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 827/1645] 10.222.0.61 () {54 vars in 912 bytes} [Wed Aug 24 05:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:52:30.357224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:30.357678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:30.358033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:30.409241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:30.412570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:30.423344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] MFA Rules not processed for user `d4dd8b81c6b94eba802960e45837253b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:30.426095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:30.436861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 828/1646] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:52:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:30.466717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:30.468552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:30.588835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 819/1647] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:30.593461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:30.696984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2069e-a314-4efa-81f9-4c05a1b80e10 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:30.712280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:30.713631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:30.714151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:30.714608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:30.731136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:30.752025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:30.773541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:30.773618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573238cd-dfc2-4ac5-b942-cfad072783bf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:30.781594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:30.785190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:30.785695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:30.786229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:30.786995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:30.788766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 829/1648] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:30.792952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:30.881032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 820/1649] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:30 2022] POST /identity/v3/projects => generated 403 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:30.884760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:30.899509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42d5d-fb6e-491f-bb76-e872986c509c service glance] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.023291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.023983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.024444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.024773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.025436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.027957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.059726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 830/1650] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:30 2022] POST /identity/v3/users => generated 308 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:31.063947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.081420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade34d8-f692-47ce-ae37-46a1c5010058 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.092158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.092852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.093138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.093461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.094737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.096377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.115605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 821/1651] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:31.120497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.135812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b53-5a0c-492d-a609-9b97aab0d597 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.142380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.143206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.143518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.143811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] PATH_INFO: `/v3/projects/fc842977cd5f44ec855db0e0156b20be/users/fd23c4c4e0da431f8858d94cac3be1f2/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.169402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.186143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc842977cd5f44ec855db0e0156b20be, user_id=fd23c4c4e0da431f8858d94cac3be1f2, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.192989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.224826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 831/1652] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:31 2022] PUT /identity/v3/projects/fc842977cd5f44ec855db0e0156b20be/users/fd23c4c4e0da431f8858d94cac3be1f2/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:31.237379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.283284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:31.332904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991aad-cd97-4387-8129-618bb58af082 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.367747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab55d-aed6-4db3-8b21-968ade78a24a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.385344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.386066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.386354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.386632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.387475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.389121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.428733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 832/1653] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:31.440661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.450757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.451495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.452518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.452518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.487919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6336ab-540e-47ad-b2e8-b6e57ede5807 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.504683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.505354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.505668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.505934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] PATH_INFO: `/v3/projects/fc842977cd5f44ec855db0e0156b20be/users/fd23c4c4e0da431f8858d94cac3be1f2/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.512182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc842977cd5f44ec855db0e0156b20be, user_id=fd23c4c4e0da431f8858d94cac3be1f2, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.516276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d991759-3642-4ea1-bce4-6801945d73e2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.545652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 833/1654] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:31 2022] PUT /identity/v3/projects/fc842977cd5f44ec855db0e0156b20be/users/fd23c4c4e0da431f8858d94cac3be1f2/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:52:31.599931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.607559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd39aa-5cfc-4d7a-99fb-8eb4deaf4cc7 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.628320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 822/1655] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:31.651762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8dbe-a939-4be9-8f11-a032f91480de None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.652535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8dbe-a939-4be9-8f11-a032f91480de None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.653176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8dbe-a939-4be9-8f11-a032f91480de None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.657147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 834/1656] 10.222.0.61 () {54 vars in 912 bytes} [Wed Aug 24 05:52:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:31.665912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486aa72-c551-440a-a0e1-f36a0c4acea6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.666329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486aa72-c551-440a-a0e1-f36a0c4acea6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.666496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486aa72-c551-440a-a0e1-f36a0c4acea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.732023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4486aa72-c551-440a-a0e1-f36a0c4acea6 None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:31.733279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4486aa72-c551-440a-a0e1-f36a0c4acea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:31.755500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:31.827592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 823/1657] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:52:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:31.878614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8dbe-a939-4be9-8f11-a032f91480de None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:31.921167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8dbe-a939-4be9-8f11-a032f91480de None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:31.932790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:31.934588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:31.935070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:31.936317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:31.964485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:31.974052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d63f33-e259-406e-9e55-d7a74bfecd80 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:31.995112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 835/1658] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:32.986873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d587f-5b74-4aa4-96f5-c419dbe2d952 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:32.987391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d587f-5b74-4aa4-96f5-c419dbe2d952 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:32.988160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d587f-5b74-4aa4-96f5-c419dbe2d952 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:32.989613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 824/1659] 10.222.0.61 () {54 vars in 961 bytes} [Wed Aug 24 05:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:33.000411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379856-42b5-4c82-9288-0446c26bc52e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:33.001120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379856-42b5-4c82-9288-0446c26bc52e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:33.001258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379856-42b5-4c82-9288-0446c26bc52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:33.068504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ff379856-42b5-4c82-9288-0446c26bc52e None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:33.075009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ff379856-42b5-4c82-9288-0446c26bc52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:33.315650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 836/1660] 10.222.0.61 () {58 vars in 1058 bytes} [Wed Aug 24 05:52:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:33.316986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d587f-5b74-4aa4-96f5-c419dbe2d952 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:33.345339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d587f-5b74-4aa4-96f5-c419dbe2d952 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:33.360259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:33.361236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:33.362263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:33.362823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:33.367472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:33.398958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:33.404839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85403f-5be0-4600-86aa-ceb6b1f8bf8d service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:33.430516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 825/1661] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:33.860444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df994b3-f398-4052-a3f5-68fe4e8d76a5 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:33.861045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df994b3-f398-4052-a3f5-68fe4e8d76a5 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:33.861331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df994b3-f398-4052-a3f5-68fe4e8d76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:33.898877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1df994b3-f398-4052-a3f5-68fe4e8d76a5 None None] MFA Rules not processed for user `4c62008668ca423dab42c576bb735b70`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:33.900252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1df994b3-f398-4052-a3f5-68fe4e8d76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:34.031572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 837/1662] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:36.421059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:36.421700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:36.421812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:36.524189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] MFA Rules not processed for user `fd23c4c4e0da431f8858d94cac3be1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:36.533048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:36.804579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 826/1663] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:37.633639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:37.634259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:37.634259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:37.809039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:37.810571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:37.847795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:38.017488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 838/1664] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:38.399212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:38.405134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:38.524589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:38.786325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ff3b6-2076-4bf5-be86-d2b335055e9b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:38.814268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7e066-10fe-4ede-bb41-51ce832c7151 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:38.817522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:38.821693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:38.824789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:38.828311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:38.840930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:38.847051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:38.847821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:38.848439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] PATH_INFO: `/v3/users/37d1bbd61c0c44678f27886c252d731c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:38.850530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d1bbd61c0c44678f27886c252d731c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:38.855383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:38.867036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:38.883327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892a72-5d84-49aa-ba2c-7dd5364661df service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:38.930357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 827/1665] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:52:39.065755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d1bbd61c0c44678f27886c252d731c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:39.067181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d1bbd61c0c44678f27886c252d731c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:39.141093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d1bbd61c0c44678f27886c252d731c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:39.145005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d1bbd61c0c44678f27886c252d731c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:39.202029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d1bbd61c0c44678f27886c252d731c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:39.275168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:39.279774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:39.286533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:39.297397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 839/1666] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:38 2022] DELETE /identity/v3/users/37d1bbd61c0c44678f27886c252d731c => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:39.363853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:39.370526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:39.387103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:39.626271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 828/1667] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:39.701305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:39.706679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:39.962857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:40.015840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de75c68-14ae-4a18-9e82-edf8ec812090 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:40.020741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:40.021796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:40.022306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:40.022832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:40.036810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:40.039887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c1b05-3ca9-4fb3-a746-e2912c6ef0bf service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:40.073960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 840/1668] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:41.744339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:41.747166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:41.789398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb22b-eca5-41f3-b996-d45ac0a41243 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:41.810440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:41.811236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:41.815313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:41.815735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] PATH_INFO: `/v3/projects/fbc1c169f2384dcba62d61a1a77f33d0` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:41.820168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc1c169f2384dcba62d61a1a77f33d0)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:41.867274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:42.364660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc1c169f2384dcba62d61a1a77f33d0', 'request_id': 'req-5db4295f-bea2-4fb6-8139-16611a660c6d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:42.407479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc1c169f2384dcba62d61a1a77f33d0', 'request_id': 'req-5db4295f-bea2-4fb6-8139-16611a660c6d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:42.444948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc1c169f2384dcba62d61a1a77f33d0', 'request_id': 'req-5db4295f-bea2-4fb6-8139-16611a660c6d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:42.498488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] The token cache is being invalidate because project fbc1c169f2384dcba62d61a1a77f33d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:52:42.498846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:42.506298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5db4295f-bea2-4fb6-8139-16611a660c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:42.516572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 829/1669] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:52:41 2022] DELETE /identity/v3/projects/fbc1c169f2384dcba62d61a1a77f33d0 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:42.518042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:42.518524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:42.518602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:42.596164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:42.613586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:43.022749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 841/1670] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:43.026520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:43.027887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:43.028580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:43.216245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:43.230034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:43.280078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 830/1671] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:43.292134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:43.334559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86485d7c-b267-449a-a435-7890309ec8e8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:43.346548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:43.347807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:43.348426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:43.349307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:43.350867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:43.351549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:43.361934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:43.414283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 842/1672] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:43.423298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:43.488053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb7ec0-c26e-4c80-8016-84919f42a37e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:43.527242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:43.533872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:43.536256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:43.540095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:43.546605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:43.561127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:43.651156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 831/1673] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:43 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:43.654866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:43.684727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683e6d4-3dc7-4fce-8f1e-928265d0effd admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:43.830794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:43.832880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:43.833441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:43.834285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:43.835891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:43.841802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:43.902861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 843/1674] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:43 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:52:43.908181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:43.930223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d753c-8819-4fb8-b984-a8852667885c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:43.954297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:43.959197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:43.959760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:43.960233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:43.961078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:43.966014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:44.010373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 832/1675] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:44.013810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:44.032783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6886c0-565d-4b01-9888-59374a5fbf8d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:44.044747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:44.050758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:44.055961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:44.057534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:44.061162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:44.073292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2d699-9322-4c8f-a38c-0c5ac709826b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:44.122030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:44.130690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 844/1676] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:44.141028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0196be-4d51-40fc-aa83-1663575bfbd0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:44.164787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:44.165021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:44.165310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:44.165612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] PATH_INFO: `/v3/projects/e8bcf0e204af43239da320f79361ad8e/users/672257d52c304f03a0a3b40f6ff0d98d/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:44.227122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bcf0e204af43239da320f79361ad8e, user_id=672257d52c304f03a0a3b40f6ff0d98d, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:44.232036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:44.263790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 833/1677] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:44 2022] PUT /identity/v3/projects/e8bcf0e204af43239da320f79361ad8e/users/672257d52c304f03a0a3b40f6ff0d98d/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:52:44.278270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:44.279749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:44.279749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:44.368953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] MFA Rules not processed for user `672257d52c304f03a0a3b40f6ff0d98d`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:44.370314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:44.483072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:44.642013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 845/1678] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:44.643249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:44.723665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:44.862066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f873-73f7-4084-892f-f98b883db437 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:44.877320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:44.878551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:44.880448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:44.880857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:44.881711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:44.886586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:44.978432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:44.984540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 834/1679] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:44 2022] POST /identity/v3/projects => generated 379 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:44.994670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a99c9-a055-4f85-982a-8c603ee88083 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:45.296500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:45.304586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:45.304929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:45.305219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:45.313540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:45.329657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:45.476686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:45.490245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 846/1680] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:44 2022] POST /identity/v3/users => generated 296 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:45.500280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67fe4-5a7a-4f75-a36f-5bfc087bf5f8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:45.515938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:45.516710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:45.516853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:45.519218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:45.529591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:45.532614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:45.600819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:45.615505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 835/1681] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:45.634638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e987-68e8-4934-8c28-cb6fe5df26bc admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:45.680841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:45.683139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:45.683930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:45.684617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] PATH_INFO: `/v3/projects/ac0abad059394bc2910563006637108a/users/e89a37a8bfee4a37a9627f704515b7ac/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:45.806259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0abad059394bc2910563006637108a, user_id=e89a37a8bfee4a37a9627f704515b7ac, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:45.812251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:45.882250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 847/1682] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:45 2022] PUT /identity/v3/projects/ac0abad059394bc2910563006637108a/users/e89a37a8bfee4a37a9627f704515b7ac/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:52:45.888049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:45.904738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db8cf-9319-43c6-a980-2b7a2f2734d5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:46.112089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:46.112883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:46.113176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:46.113461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:46.114172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:46.115830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40047c7-a465-4b40-bb11-afb36c293bd1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:46.157717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 836/1683] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:46.160531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:46.200526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317ef9c-0bca-4460-b613-d9db8aa7fb2c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:46.224436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:46.225915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:46.226338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:46.226826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] PATH_INFO: `/v3/projects/ac0abad059394bc2910563006637108a/users/e89a37a8bfee4a37a9627f704515b7ac/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:46.234796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0abad059394bc2910563006637108a, user_id=e89a37a8bfee4a37a9627f704515b7ac, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:46.243024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:46.285753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 848/1684] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:46 2022] PUT /identity/v3/projects/ac0abad059394bc2910563006637108a/users/e89a37a8bfee4a37a9627f704515b7ac/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:46.290951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d141-439d-4e80-b434-959d3f4d0a70 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:46.291643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d141-439d-4e80-b434-959d3f4d0a70 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:46.292133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d141-439d-4e80-b434-959d3f4d0a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:46.408627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fc83d141-439d-4e80-b434-959d3f4d0a70 None None] MFA Rules not processed for user `e89a37a8bfee4a37a9627f704515b7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:46.415565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fc83d141-439d-4e80-b434-959d3f4d0a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:46.710062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 837/1685] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:46.740527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:46.742839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:46.971443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3b31-c27a-41a3-8ee2-4daa2065a47b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:46.981979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:46.986874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:46.987361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:46.987954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.010529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:47.012132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:47.066565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 849/1686] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:47.089735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:47.091502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:47.092405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.191068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:47.193992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:47.347029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:47.519293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 838/1687] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 05:52:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:47.522332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:47.544667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309101-1ca3-41c2-8b4c-b0a663096ca4 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:47.581979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:47.582777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:47.583172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:47.583559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.645781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:47.691263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:47.694202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:47.731824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de1a95-7783-4bf4-9d65-9b664361b02e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:47.748779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:47.754278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:47.755305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:47.756650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.785706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:47.787882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ee784-c5f3-4522-9047-5f236fed8fab service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:47.807160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:47.808920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d391e-5345-4911-b441-faf244ca6971 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:47.815148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 839/1688] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:47.830568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 850/1689] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:47.842601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:47.843162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:47.843648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.845503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 840/1690] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:47.890740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1aeadf-ab26-4b24-96c9-ac8db3ab3be6 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:47.891290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1aeadf-ab26-4b24-96c9-ac8db3ab3be6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:47.891785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1aeadf-ab26-4b24-96c9-ac8db3ab3be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:47.932018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-fa1aeadf-ab26-4b24-96c9-ac8db3ab3be6 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:47.938064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fa1aeadf-ab26-4b24-96c9-ac8db3ab3be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:48.200730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 851/1691] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:52:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:48.321474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:48.330922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:48.413440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40624e09-c2a3-4063-a865-a4b7e72e37b5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:48.445836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:48.449644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:48.450082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:48.451457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:48.488334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:48.491027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184675e-a4aa-47cc-a7cd-18c3922af0a4 service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:48.541358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:48.541935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:48.542303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:48.576092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 841/1692] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:48.624952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] MFA Rules not processed for user `92ba8e92c99641cfb418266f5374f0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:48.628169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:48.761298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 852/1693] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:48.777473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:48.778178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:48.778905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:48.852132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] MFA Rules not processed for user `92ba8e92c99641cfb418266f5374f0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:48.854592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:48.909609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 842/1694] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:48.926111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:48.928872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:49.017748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:49.072710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c70c-e724-452c-98c1-ba41507980b2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.081337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.082363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.082829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.084792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.094324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.096227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc41d99-56d8-448f-af20-bdf1f5dc2892 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.108066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 853/1695] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:51.523864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:51.526645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:51.820451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d188-2973-4d2f-a97a-2f2cd9a73d48 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:51.848490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:51.849246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:51.849815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:51.850464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] PATH_INFO: `/v3/users/663939b4b57d40d29961d0c82fcc562c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:51.853835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=663939b4b57d40d29961d0c82fcc562c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:51.858731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: WARNING py.warnings [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:51.858731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: warnings.warn(msg) Aug 24 05:52:51.858731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: Aug 24 05:52:51.865591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:52.205862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663939b4b57d40d29961d0c82fcc562c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:52.207018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663939b4b57d40d29961d0c82fcc562c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:52.208680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663939b4b57d40d29961d0c82fcc562c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:52.283565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663939b4b57d40d29961d0c82fcc562c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:52.314366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663939b4b57d40d29961d0c82fcc562c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:52.368960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 843/1696] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:51 2022] DELETE /identity/v3/users/663939b4b57d40d29961d0c82fcc562c => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:52.376955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524372a-b15d-4ae0-83c7-09d42496ba55 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:52.377534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524372a-b15d-4ae0-83c7-09d42496ba55 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:52.378800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524372a-b15d-4ae0-83c7-09d42496ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:52.510682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9524372a-b15d-4ae0-83c7-09d42496ba55 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:52.512885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9524372a-b15d-4ae0-83c7-09d42496ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:52.885587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 854/1697] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:52.914524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:52.918476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:52.971891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:53.108267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99f85-9f6e-4e6f-b3b0-c0e9bd5e4cfc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:53.120949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:53.123029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:53.123609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:53.124226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:53.177280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:53.180131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5a73e-79e3-4605-9621-5d6c5beaefbf service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:53.228597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 844/1698] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:53.315398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:53.315763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:53.316165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:53.410163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] MFA Rules not processed for user `74a53d36cb7549479e0d4692ffde1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:53.412440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:53.441761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401d23-dd17-4433-9a04-1eaa7e7e4f46 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:53.442444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401d23-dd17-4433-9a04-1eaa7e7e4f46 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:53.442887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1401d23-dd17-4433-9a04-1eaa7e7e4f46 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:53.444937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 845/1699] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:53.583423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:53.583722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:53.584142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:53.618655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 855/1700] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:53.652072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] MFA Rules not processed for user `9dccfa8372374f06b49680ed24b3020c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:53.653387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:53.658031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:53.659972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:53.992414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:54.035678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5100c-1a12-4a3c-aa96-8adf9aef9c39 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:54.065905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:54.066620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:54.066959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:54.067243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:54.103703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 846/1701] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:52:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:54.104886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:54.108189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:54.130747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:54.132804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:54.203122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0705d-bb48-4c55-8fe3-a62dd2ee2198 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:54.220824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 856/1702] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:54.244991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:54.246994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:54.249989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:54.250502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] PATH_INFO: `/v3/users/d4dd8b81c6b94eba802960e45837253b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:54.254816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dd8b81c6b94eba802960e45837253b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:54.266779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:54.371738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:54.373638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:54.431934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671543-8bfe-435f-af6a-487f033a3bf9 service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:54.460761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:54.462678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:54.467323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:54.476607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dd8b81c6b94eba802960e45837253b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:54.477836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:54.486296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dd8b81c6b94eba802960e45837253b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:54.489283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dd8b81c6b94eba802960e45837253b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:54.528646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:54.532986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85508e9-ae12-4466-826f-1780a63a5013 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:54.561191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dd8b81c6b94eba802960e45837253b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:54.599025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f90fdf68-6cc2-46e4-80fb-6dac774eadc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dd8b81c6b94eba802960e45837253b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:54.606648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 857/1703] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:54.641109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 847/1704] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:54 2022] DELETE /identity/v3/users/d4dd8b81c6b94eba802960e45837253b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:56.572208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:56.572835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:56.573218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:56.577729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 858/1705] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:52:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:56.587958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c462c-85a9-4d4c-b971-0fe450460d01 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:56.588564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c462c-85a9-4d4c-b971-0fe450460d01 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:56.588762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c462c-85a9-4d4c-b971-0fe450460d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:56.640348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ef2c462c-85a9-4d4c-b971-0fe450460d01 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:56.644294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ef2c462c-85a9-4d4c-b971-0fe450460d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:56.772609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:56.862273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:56.864547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:57.072082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 848/1706] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:52:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:57.211855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108409e-4bb3-4ac3-bcb5-74375efb1597 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:57.231390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:57.232570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:57.233634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:57.234142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] PATH_INFO: `/v3/projects/8c0f78af99c64433afb745a0cb1d1027` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:57.235683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0f78af99c64433afb745a0cb1d1027)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:57.236986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: WARNING py.warnings [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:52:57.236986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: warnings.warn(msg) Aug 24 05:52:57.236986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: Aug 24 05:52:57.239008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:57.380676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0f78af99c64433afb745a0cb1d1027', 'request_id': 'req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.401143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0f78af99c64433afb745a0cb1d1027', 'request_id': 'req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.435003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0f78af99c64433afb745a0cb1d1027', 'request_id': 'req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.449962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:57.450505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:57.450983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:57.482600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] The token cache is being invalidate because project 8c0f78af99c64433afb745a0cb1d1027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:52:57.483483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.488491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.500881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 859/1707] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:52:56 2022] DELETE /identity/v3/projects/8c0f78af99c64433afb745a0cb1d1027 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:57.502997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:57.507509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:57.547078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] MFA Rules not processed for user `e47e1b7589bb427aa13c27f7bc1d6d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:57.552949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:57.709465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5c91-3314-4d4e-8c26-2ae8e9d2338f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:57.725132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:57.726198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:57.726853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:57.727329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] PATH_INFO: `/v3/users/2dc12fd04e034d01b65241ef8a1da599` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:57.729910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc12fd04e034d01b65241ef8a1da599)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:57.734169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:57.749798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:57.856148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc12fd04e034d01b65241ef8a1da599'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.859412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc12fd04e034d01b65241ef8a1da599'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.891407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc12fd04e034d01b65241ef8a1da599'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.894769 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc12fd04e034d01b65241ef8a1da599'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:57.923824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc12fd04e034d01b65241ef8a1da599'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.004610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 860/1708] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:57 2022] DELETE /identity/v3/users/2dc12fd04e034d01b65241ef8a1da599 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:52:58.012131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:58.019208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:58.024209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 849/1709] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:58.029317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:58.038875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:58.314769 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f572-505b-48ea-876a-ce659e279711 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:58.331315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:58.333977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:58.335868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:58.336278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] PATH_INFO: `/v3/projects/45a0a2d297884a40a13d1018ebc706fa` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:58.338322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a0a2d297884a40a13d1018ebc706fa)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:58.344786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:58.480574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a0a2d297884a40a13d1018ebc706fa', 'request_id': 'req-da5595cd-881a-49e0-95ff-6d68d2be1952'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.506366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a0a2d297884a40a13d1018ebc706fa', 'request_id': 'req-da5595cd-881a-49e0-95ff-6d68d2be1952'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.528880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a0a2d297884a40a13d1018ebc706fa', 'request_id': 'req-da5595cd-881a-49e0-95ff-6d68d2be1952'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.558152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] The token cache is being invalidate because project 45a0a2d297884a40a13d1018ebc706fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:52:58.558575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.559219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:58.564509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 861/1710] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:52:58 2022] DELETE /identity/v3/projects/45a0a2d297884a40a13d1018ebc706fa => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:58.565417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:58.569360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:58.602823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e63d38-eebe-48a1-a9a2-6dfc4d030951 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:58.639851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:58.837061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:58.845830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5595cd-881a-49e0-95ff-6d68d2be1952 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:58.860778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:58.861721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:58.862159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:58.862515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:58.865584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:58.899677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:58.900406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:58.900700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:58.900980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:58.902890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:58.942793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:58.944679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:58.979841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 850/1711] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 954 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:59.004652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:59.006140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:59.061072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:59.064128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984edd7-f757-4762-811c-0c787b54d809 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:59.081527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 862/1712] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:59.087950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:59.090293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:59.091857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:59.097458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 863/1713] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:52:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:52:59.100231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:59.104195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:59.205520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa90b4e-9e9f-45f6-b464-f90c23038528 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:59.223311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:59.226929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:59.228488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:59.228846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] PATH_INFO: `/v3/users/fd23c4c4e0da431f8858d94cac3be1f2` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:59.232575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd23c4c4e0da431f8858d94cac3be1f2)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:59.239793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:59.319759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355775-dd59-4729-9c52-9572444cc032 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:59.331846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:59.332366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:59.332513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:59.332821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] PATH_INFO: `/v3/users/672257d52c304f03a0a3b40f6ff0d98d` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:59.339151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=672257d52c304f03a0a3b40f6ff0d98d)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:59.341178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:59.400166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd23c4c4e0da431f8858d94cac3be1f2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.401186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd23c4c4e0da431f8858d94cac3be1f2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.404124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd23c4c4e0da431f8858d94cac3be1f2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.446138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd23c4c4e0da431f8858d94cac3be1f2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.480271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c455137d-1a22-451a-9b3e-99f72ded1b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd23c4c4e0da431f8858d94cac3be1f2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.514377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672257d52c304f03a0a3b40f6ff0d98d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.522215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672257d52c304f03a0a3b40f6ff0d98d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.531675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 851/1714] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:59 2022] DELETE /identity/v3/users/fd23c4c4e0da431f8858d94cac3be1f2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:59.542188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:59.549417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:59.551488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:59.553094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:59.578167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672257d52c304f03a0a3b40f6ff0d98d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.581141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672257d52c304f03a0a3b40f6ff0d98d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.610235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2c5414e8-a592-4de4-9131-7c9367c85e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672257d52c304f03a0a3b40f6ff0d98d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:59.651196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:59.653749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 864/1715] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:59 2022] DELETE /identity/v3/users/672257d52c304f03a0a3b40f6ff0d98d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:59.657498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:59.658167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:59.661091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:59.661380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:59.735008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:59.737504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:59.893913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 865/1716] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:59.901730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:59.952910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 852/1717] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:52:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:59.987121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:59.989397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:00.044869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:00.046449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:00.076405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a3de2-431a-40a9-a701-abaa8194b919 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:00.083979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:00.084620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:00.084906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:00.085184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:00.102931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:00.104632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:00.122359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738cb5-faa5-431d-8774-1cd6b8258d70 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:00.129150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:00.130404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:00.130888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:00.131633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:00.140778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 853/1718] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:00.153093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:00.160478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fa13d-3f21-4fef-b1a3-5c93eda2d14b service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:00.198062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 866/1719] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:00.623582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:00.625163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:00.644110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca806a-0c6b-4268-8827-306dfd706d7c service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:00.650076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:00.650752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:00.651209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:00.652243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] PATH_INFO: `/v3/projects/608dd09423414ff3ae08723c9090e619` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:00.653862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608dd09423414ff3ae08723c9090e619)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:00.657055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:00.762142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608dd09423414ff3ae08723c9090e619', 'request_id': 'req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:00.814609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608dd09423414ff3ae08723c9090e619', 'request_id': 'req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:00.824837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608dd09423414ff3ae08723c9090e619', 'request_id': 'req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:00.863857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] The token cache is being invalidate because project 608dd09423414ff3ae08723c9090e619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:00.864400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:00.866662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fe9808a6-ac7f-40e2-b4ff-a0a5bf414815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:00.869450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 854/1720] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:00 2022] DELETE /identity/v3/projects/608dd09423414ff3ae08723c9090e619 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:00.875737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:00.876122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:00.876478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:00.909715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:00.911098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.030269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 867/1721] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:01.040223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.040790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.041068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.082997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:01.085941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.109680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 855/1722] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:01.111556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.127226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48e8c-2dff-4bc1-8b5d-3bacfa1daf51 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.138791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.141809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.143338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.143724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.144587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:01.145529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.148891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.192650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 868/1723] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:01.192987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.208018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954eb20-3d53-4794-ac94-e88dc53aab37 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.215517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.216585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.218369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.218837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.220417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.224287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.275137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 856/1724] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:01 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:01.281678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.292238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:01.304918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c617-0eb3-432c-a409-f74233933cf3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.497354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.500942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.502298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.502657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.504607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.511070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.562703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 869/1725] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:01 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:01.566233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.583889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d970a-d84f-4574-97c4-a4ee5b7a670c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.591600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.593039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.593734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.593734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.594439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.596906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.616417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 857/1726] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:01.619910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.648096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffd796-36b6-479b-a73e-560804d9de4f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.655937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.657991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.658848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.659401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.660750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.662922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.682242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 870/1727] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:01.687435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.700653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.705979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.707136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf31b56-8160-4e03-afa0-ab77c86d9a78 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.721223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.726524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.726965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.727429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] PATH_INFO: `/v3/projects/a38623989e6e4ab6a2faaa65fbec8e5d/users/b56ea6e759cf45d49ef57e4864887d2b/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.750686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e7d4c-8195-43a0-8e59-857d6d1bd775 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.763532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.765129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.767947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.768471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] PATH_INFO: `/v3/projects/fc842977cd5f44ec855db0e0156b20be` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.771509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc842977cd5f44ec855db0e0156b20be)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.773538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38623989e6e4ab6a2faaa65fbec8e5d, user_id=b56ea6e759cf45d49ef57e4864887d2b, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.778007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cae20c-541b-472a-91ba-d822cf84ba15 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.780730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.828854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 858/1728] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:01 2022] PUT /identity/v3/projects/a38623989e6e4ab6a2faaa65fbec8e5d/users/b56ea6e759cf45d49ef57e4864887d2b/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:01.834779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.835269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.835703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.917158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] MFA Rules not processed for user `b56ea6e759cf45d49ef57e4864887d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:01.919839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.924486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc842977cd5f44ec855db0e0156b20be', 'request_id': 'req-19a615c8-26f0-498e-96bd-a40b95d12730'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:01.953455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc842977cd5f44ec855db0e0156b20be', 'request_id': 'req-19a615c8-26f0-498e-96bd-a40b95d12730'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:01.963598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc842977cd5f44ec855db0e0156b20be', 'request_id': 'req-19a615c8-26f0-498e-96bd-a40b95d12730'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:01.993500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] The token cache is being invalidate because project fc842977cd5f44ec855db0e0156b20be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:01.995040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:02.000736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19a615c8-26f0-498e-96bd-a40b95d12730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:02.002795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 871/1729] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:01 2022] DELETE /identity/v3/projects/fc842977cd5f44ec855db0e0156b20be => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:02.010813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd5dc-bc2d-4f1e-b4f7-5f1c5b5fa141 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.011133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd5dc-bc2d-4f1e-b4f7-5f1c5b5fa141 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.011597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd5dc-bc2d-4f1e-b4f7-5f1c5b5fa141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.051917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:02.054308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-984bd5dc-bc2d-4f1e-b4f7-5f1c5b5fa141 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:02.065986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-984bd5dc-bc2d-4f1e-b4f7-5f1c5b5fa141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:02.112873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 859/1730] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:02.114545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.117004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:02.211812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 872/1731] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:02.225099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.225756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.226101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.239558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:02.269343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:02.270999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:02.293666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 873/1732] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:02.296282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.308572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7b75-0095-4949-8270-0b75f3410e91 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.313475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c1b2-14d0-419d-bf44-869386bf34fc None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.318261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.319683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.320421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.321212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.322846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.328034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.328672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.328954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.329237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.329619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.329986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:02.330295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.331922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.365966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 874/1733] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:02.367012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.387134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da31f-cce4-4124-87b7-0445b1a5970b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.393659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.394328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.394613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.394887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.397735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.399779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.403778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 860/1734] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:02.408916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.473261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 875/1735] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:02.474623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.532509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6079-a227-4c21-a828-9a8b41a5f328 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.599098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b191491-b934-4434-92ed-015aeb88dc69 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.604416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.605528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.605852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.606135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.606775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.608770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.609177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.610078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.610482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.610857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.611595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.613959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.641544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 876/1736] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:02.642597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.647875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 861/1737] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:02 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:02.650981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.655735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8588-0b0c-4c67-bba4-059ad5ce0ca9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.661524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:02.662009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.662698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.663040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.663469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.669958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1018-f4a1-4426-83f0-48b333f0137e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.675826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.678914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.690360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.692399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.692804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.693499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.695501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.699531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.705089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 877/1738] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:02.707242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.727117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832a7e-f0d9-42ed-ab57-40ed2fdcfe8d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.732104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.732765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.733176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.733456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.736955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 862/1739] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:02.737167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.737167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.739608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.762601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333835-aa91-4416-bee6-88de36e3d8ca admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.772235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 878/1740] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:02.777678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.783583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.784328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.784617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.784897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] PATH_INFO: `/v3/projects/3d28427a94164693948b463ba458982f/users/fc912d9f6e064022aa971d39dba36908/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.805344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc50c3-6923-46f4-b2c2-3b322943281d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:02.819991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:02.822934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:02.823355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:02.823851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] PATH_INFO: `/v3/projects/80d8d2fd48c4446eb03b55bcd778374a/users/340bc2a64f4340c791d3ab2590814ab0/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:02.833058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d28427a94164693948b463ba458982f, user_id=fc912d9f6e064022aa971d39dba36908, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.838952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.857718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d8d2fd48c4446eb03b55bcd778374a, user_id=340bc2a64f4340c791d3ab2590814ab0, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:02.862972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:02.876747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 863/1741] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:02 2022] PUT /identity/v3/projects/3d28427a94164693948b463ba458982f/users/fc912d9f6e064022aa971d39dba36908/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:02.877731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.899248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 879/1742] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:02 2022] PUT /identity/v3/projects/80d8d2fd48c4446eb03b55bcd778374a/users/340bc2a64f4340c791d3ab2590814ab0/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:02.913370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:02.915407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:03.042262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b93-6e0d-464b-8132-9602ef27215e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:03.099257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6d2b2-f309-4ba5-9a55-a1ee03fc8e28 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:03.114300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:03.121990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.121990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.121990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] PATH_INFO: `/v3/projects/e8bcf0e204af43239da320f79361ad8e` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.121990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bcf0e204af43239da320f79361ad8e)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:03.121990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:03.153205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:03.243045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:03.243874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.246246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.246566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.247265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:03.250058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9af1-db9a-426c-8a15-0029feeff033 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:03.275324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 864/1743] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:03.275324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.275324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.275324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.309883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bcf0e204af43239da320f79361ad8e', 'request_id': 'req-e8d13b1a-57e6-4885-82cf-9009bf394b50'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.351783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bcf0e204af43239da320f79361ad8e', 'request_id': 'req-e8d13b1a-57e6-4885-82cf-9009bf394b50'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.362470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bcf0e204af43239da320f79361ad8e', 'request_id': 'req-e8d13b1a-57e6-4885-82cf-9009bf394b50'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.387593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] MFA Rules not processed for user `340bc2a64f4340c791d3ab2590814ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:03.389530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:03.399266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] The token cache is being invalidate because project e8bcf0e204af43239da320f79361ad8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:03.399575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.406308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.411128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 880/1744] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:02 2022] DELETE /identity/v3/projects/e8bcf0e204af43239da320f79361ad8e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:03.412089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:03.418964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:03.732747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 865/1745] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:03.734424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:03.741060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:03.751733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d13b1a-57e6-4885-82cf-9009bf394b50 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:03.769671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:03.773314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadd3a0-7a22-4a90-a3c8-36417e8a5529 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:03.775483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:03.776394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.777566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.778476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] PATH_INFO: `/v3/projects/3d28427a94164693948b463ba458982f/users/fc912d9f6e064022aa971d39dba36908/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.781917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d28427a94164693948b463ba458982f, user_id=fc912d9f6e064022aa971d39dba36908, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:03.787325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:03.792309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:03.793037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.793330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.793616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] PATH_INFO: `/v3/users/e89a37a8bfee4a37a9627f704515b7ac` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.794831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89a37a8bfee4a37a9627f704515b7ac)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:03.798560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:03.832529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 881/1746] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:03 2022] PUT /identity/v3/projects/3d28427a94164693948b463ba458982f/users/fc912d9f6e064022aa971d39dba36908/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:03.834227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:03.838638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:03.921439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89a37a8bfee4a37a9627f704515b7ac'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.923548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89a37a8bfee4a37a9627f704515b7ac'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.924801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89a37a8bfee4a37a9627f704515b7ac'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.963397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89a37a8bfee4a37a9627f704515b7ac'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:03.970381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c847-167d-46c5-83d3-b27db62f3b4a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:03.976747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:03.977796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:03.978130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:03.978415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:03.979296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:03.981500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:03.986304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6117b1fd-106c-447e-97c7-e8e976369cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89a37a8bfee4a37a9627f704515b7ac'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:04.016175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 866/1747] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:03 2022] DELETE /identity/v3/users/e89a37a8bfee4a37a9627f704515b7ac => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:04.019186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.019186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.019186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.024509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 882/1748] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:03 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:04.030525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:04.033399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:04.060007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:04.125800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] MFA Rules not processed for user `fc912d9f6e064022aa971d39dba36908`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:04.130286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:04.164011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729087-eda7-454d-b610-27232808f3e3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:04.182312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:04.182965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.183253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.183527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.184174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:04.187944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7909a2-c5e1-49c1-94f5-d1b099bf43ee admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:04.263568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 883/1749] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:04 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:04.263568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.263568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.263568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.310548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] MFA Rules not processed for user `74a53d36cb7549479e0d4692ffde1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:04.315816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:04.444223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 867/1750] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:04.445205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:04.467344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 884/1751] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:04.470299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64752b10-c9ea-4852-852a-0565ffe4efb6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:04.473416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:04.475453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:04.480880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:04.481924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.482428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.483744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.486053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:04.489424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:04.521150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 868/1752] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:04.522780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:04.543977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f2e7f-dee6-4025-bedd-676e6905d08f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:04.583131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:04.584282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.584732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.585157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] PATH_INFO: `/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5/users/9b186983d4a044959a48d448f7f8469b/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.621156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e886d8afd2f45b58c31a76d14cc24e5, user_id=9b186983d4a044959a48d448f7f8469b, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:04.626303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d134e-1bd4-41bf-be52-698a4f55c7d2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:04.661243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043585-4d2f-4160-9c35-8c387b983661 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:04.698859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 869/1753] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:04 2022] PUT /identity/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5/users/9b186983d4a044959a48d448f7f8469b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:04.700562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.701042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.705850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.789834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] MFA Rules not processed for user `e47e1b7589bb427aa13c27f7bc1d6d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:04.797960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:04.860015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:04.866901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:04.867513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:04.867982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:04.886928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:04.979267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:05.085951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 870/1754] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:05.087511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:05.176214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:05.183867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf744-e850-4228-ad6b-60484e519db1 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:05.253741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 885/1755] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:05.329029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f96d0-3c2f-4193-b1c3-43dff023c922 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:05.340287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:05.340548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.340873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.341315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.343051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:05.345876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:05.380387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa0e0-322d-42b6-992f-503ab5b90caf None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.380682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa0e0-322d-42b6-992f-503ab5b90caf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.380970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa0e0-322d-42b6-992f-503ab5b90caf None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.382635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 886/1756] 10.222.0.61 () {54 vars in 912 bytes} [Wed Aug 24 05:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:53:05.389749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.390264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.390739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.392735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 871/1757] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:05.410259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:05.424904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1c5e-22d3-43b9-b276-2b94d7681855 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:05.439101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:05.439101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.439101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.439591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] PATH_INFO: `/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5/users/9b186983d4a044959a48d448f7f8469b/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.442507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e886d8afd2f45b58c31a76d14cc24e5, user_id=9b186983d4a044959a48d448f7f8469b, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:05.446551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212c0b3-ca29-452f-aeb5-af74a8e4cc94 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:05.463204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:05.464384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:05.464625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 872/1758] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:05 2022] PUT /identity/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5/users/9b186983d4a044959a48d448f7f8469b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:05.475905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.476418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.476797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.554379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] MFA Rules not processed for user `9b186983d4a044959a48d448f7f8469b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:05.555641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:05.731938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 887/1759] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:53:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:05.869628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:05.875392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:05.887394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 873/1760] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:05.904304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:05.917200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f671e62-05c8-4661-aa88-553162499c30 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:05.938471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:05.940339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:05.940649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:05.940918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:05.977967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:05.991384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.016954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 888/1761] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:06.024805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:06.030307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:06.064140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:06.092053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb066e7-a9c1-47b4-89e2-c185b1510e09 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:06.102361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:06.103196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.103485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.103744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.128819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:06.130956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.171393 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 874/1762] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:06.206836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee08d-4a2f-4aff-bec5-e1e5e9d573ac service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:06.219878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:06.220723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.221069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.221467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] PATH_INFO: `/v3/projects/ac0abad059394bc2910563006637108a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.224037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0abad059394bc2910563006637108a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:06.227462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.357013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:06.359422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:06.362766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0abad059394bc2910563006637108a', 'request_id': 'req-b7d86d41-2f05-4c06-ada0-68f3e77781ea'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.367258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:06.378872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0abad059394bc2910563006637108a', 'request_id': 'req-b7d86d41-2f05-4c06-ada0-68f3e77781ea'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.385363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05665-04dc-44ca-b0ba-c1aeea46df62 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:06.394435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0abad059394bc2910563006637108a', 'request_id': 'req-b7d86d41-2f05-4c06-ada0-68f3e77781ea'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.421045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] The token cache is being invalidate because project ac0abad059394bc2910563006637108a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:06.421390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.422776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b7d86d41-2f05-4c06-ada0-68f3e77781ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.425592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 889/1763] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:06 2022] DELETE /identity/v3/projects/ac0abad059394bc2910563006637108a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:06.440224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c1e4-4978-4b49-b43e-0fab38615006 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.440729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c1e4-4978-4b49-b43e-0fab38615006 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.441065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c1e4-4978-4b49-b43e-0fab38615006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.468153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0cf7c1e4-4978-4b49-b43e-0fab38615006 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:06.470565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0cf7c1e4-4978-4b49-b43e-0fab38615006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:06.567933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 890/1764] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:06.570243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.570533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.570815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.590632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:06.591316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.591604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.591925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] PATH_INFO: `/v3/users/b56ea6e759cf45d49ef57e4864887d2b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.593550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56ea6e759cf45d49ef57e4864887d2b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:06.595557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.603466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:06.606367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:06.644256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 891/1765] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:06.646130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:06.667279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2082b1-4143-451c-8f8f-cf6436175b59 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:06.677156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:06.677818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.678120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.678400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.679173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:06.679368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:06.681039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.707758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 892/1766] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:53:06.712574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:06.724536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56ea6e759cf45d49ef57e4864887d2b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.726307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56ea6e759cf45d49ef57e4864887d2b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.726964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56ea6e759cf45d49ef57e4864887d2b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.736475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8b6b9-54a6-4234-bc78-784742b8d441 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:06.752534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:06.753210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.753584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.753816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.755462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:06.756766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:06.758876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56ea6e759cf45d49ef57e4864887d2b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.780836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f2712bfd-69a7-4d76-b3c0-e45fb33f7014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56ea6e759cf45d49ef57e4864887d2b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:06.819475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 875/1767] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:06 2022] DELETE /identity/v3/users/b56ea6e759cf45d49ef57e4864887d2b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:06.824650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.824970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.825636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.830499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 893/1768] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:06.832501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:06.835438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:06.884325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:06.884949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.066364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd82f-ec7d-4524-b8e3-fdd83657b36e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.080692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.087507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.087507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.087507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.087507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.087862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.088734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:07.122621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 876/1769] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:07.123443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 894/1770] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/users => generated 282 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:07.134006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.136046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.140734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.164314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac1e1d-4b18-4a2e-b08d-76c6b06a6d13 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.181933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.183350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.186199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.186199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.188643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.193312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.245367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 877/1771] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:07.247764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.270853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:07.302342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aaf6f-7fef-4731-a570-be79afb2b346 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.322784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.322784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.322784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.322784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.323200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.336718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.360947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e0de-7cc2-4a62-84ee-e97aa4060120 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.372131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.372930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.373129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 878/1772] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:07.373473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.373921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.376268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.411770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.412517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8633-3251-4934-a5f4-9b4f181c7004 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.414730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed182005-a14d-46f9-a250-bbb73bd906ca service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.426401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.427225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.427615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.428437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] PATH_INFO: `/v3/projects/09e1e4cf79744e2faf5a790019f41e57/users/35949dc40ef74cdd9838c4fddd0ff23e/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.447198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 895/1773] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:07.458700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e1e4cf79744e2faf5a790019f41e57, user_id=35949dc40ef74cdd9838c4fddd0ff23e, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.461963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.486134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 879/1774] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:07 2022] PUT /identity/v3/projects/09e1e4cf79744e2faf5a790019f41e57/users/35949dc40ef74cdd9838c4fddd0ff23e/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:07.506161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.506711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.506971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.632635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] MFA Rules not processed for user `35949dc40ef74cdd9838c4fddd0ff23e`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:07.635765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.824214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.827865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.874551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 896/1775] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:07.886833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:08.144074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942ad8-e5bf-418b-a1cc-6987153f2a22 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:08.151702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1305-8eed-4347-bdf0-e8aab90a3ce7 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:08.182448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:08.183376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.183762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.184052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] PATH_INFO: `/v3/users/757b14b86ca1417996c353b423b27b55` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.192413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757b14b86ca1417996c353b423b27b55)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:08.194345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:08.195088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.195405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.195806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.196626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:08.210075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:08.213457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:08.312254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 897/1776] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:07 2022] POST /identity/v3/projects => generated 367 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:08.330012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:08.391812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757b14b86ca1417996c353b423b27b55'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:08.394840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757b14b86ca1417996c353b423b27b55'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:08.401126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757b14b86ca1417996c353b423b27b55'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:08.443596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757b14b86ca1417996c353b423b27b55'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:08.464704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ded5e578-fc2b-46a6-8d71-93a6c31d89f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757b14b86ca1417996c353b423b27b55'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:08.508980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 880/1777] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:07 2022] DELETE /identity/v3/users/757b14b86ca1417996c353b423b27b55 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:08.511149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1ae6-d9bf-480c-8f3f-fca29b2d0bd3 None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.513435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1ae6-d9bf-480c-8f3f-fca29b2d0bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.515190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1ae6-d9bf-480c-8f3f-fca29b2d0bd3 None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.517492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 881/1778] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:53:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:53:08.523657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3275d2-6684-443f-8d4a-65073d9f2d5f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.525081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3275d2-6684-443f-8d4a-65073d9f2d5f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.525589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3275d2-6684-443f-8d4a-65073d9f2d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.537882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:08.576892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05043-bcd1-4b28-8c68-1433718bd7f5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:08.597060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9c3275d2-6684-443f-8d4a-65073d9f2d5f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:08.601729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9c3275d2-6684-443f-8d4a-65073d9f2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:08.695162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:08.764716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:08.765506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.766552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.766552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.768726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:08.773429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:08.789588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 882/1779] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:08.789588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:08.789588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:08.789588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:08.829018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 898/1780] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:08 2022] POST /identity/v3/users => generated 290 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:08.830845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:08.836844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:08.844078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:08.849667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:08.961434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 883/1781] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:53:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:08.962387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:08.963742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:08.986283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be690b-08d6-4334-b6ab-05f5e59bbc73 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:08.999425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.000797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.001338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.001836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.003228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.006317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.025514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 884/1782] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:09.026194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8345ed-71d2-44c6-9300-493c630876a4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.026865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.030744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.032040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.036058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.036650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.037130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.052121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.052804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea0e06-2ac7-4bdc-b39a-75d8fe337f4c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.054684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.062077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.062981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.063439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.063912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] PATH_INFO: `/v3/projects/a38623989e6e4ab6a2faaa65fbec8e5d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.066742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 899/1783] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:09.067837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.069444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.078754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38623989e6e4ab6a2faaa65fbec8e5d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.087028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.087803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a4f5-d83d-475f-86ed-23ba4e26561d service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.097173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.098999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.099473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.099923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.114309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.116698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.132028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 900/1784] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:09.133162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.145745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d047b-c911-4eba-807d-dc5707d8f6fc service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.159345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.160304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.160752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.162580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] PATH_INFO: `/v3/projects/5c56e7112bb14773a037f4aedd569edd/users/bb2b2fa73255451299db6db26145393d/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.205606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56e7112bb14773a037f4aedd569edd, user_id=bb2b2fa73255451299db6db26145393d, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.206897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.233715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 901/1785] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:09 2022] PUT /identity/v3/projects/5c56e7112bb14773a037f4aedd569edd/users/bb2b2fa73255451299db6db26145393d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:09.238886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.268611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38623989e6e4ab6a2faaa65fbec8e5d', 'request_id': 'req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.287225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38623989e6e4ab6a2faaa65fbec8e5d', 'request_id': 'req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.302430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38623989e6e4ab6a2faaa65fbec8e5d', 'request_id': 'req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.320811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] The token cache is being invalidate because project a38623989e6e4ab6a2faaa65fbec8e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:09.321197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.321892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.328594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 885/1786] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:09 2022] DELETE /identity/v3/projects/a38623989e6e4ab6a2faaa65fbec8e5d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:09.329915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.338831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.377190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:09.396320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035138c-9d18-4d8d-b92c-339e5985f001 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.454889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:09.486072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0de0-4f4c-4fb6-bd2c-52b471f490ea admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.492789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.493468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.493747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.494074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] PATH_INFO: `/v3/users/fc912d9f6e064022aa971d39dba36908` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.496421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc912d9f6e064022aa971d39dba36908)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.498491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.507582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.509641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.510664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.512631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.514515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.518008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.567497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 902/1787] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:09.569216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.573012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.593290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76509-a5a2-4ec7-9f3d-3ef101f8020d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.603454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.604262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.604734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.605172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] PATH_INFO: `/v3/users/340bc2a64f4340c791d3ab2590814ab0` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.607070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340bc2a64f4340c791d3ab2590814ab0)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.609359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.632987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc912d9f6e064022aa971d39dba36908'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.635728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc912d9f6e064022aa971d39dba36908'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.637108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc912d9f6e064022aa971d39dba36908'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.663173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc912d9f6e064022aa971d39dba36908'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.680416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc912d9f6e064022aa971d39dba36908'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.715624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 886/1788] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:09 2022] DELETE /identity/v3/users/fc912d9f6e064022aa971d39dba36908 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:09.717211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.727116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.752401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340bc2a64f4340c791d3ab2590814ab0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.753389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340bc2a64f4340c791d3ab2590814ab0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.783429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340bc2a64f4340c791d3ab2590814ab0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.784823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340bc2a64f4340c791d3ab2590814ab0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.797860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340bc2a64f4340c791d3ab2590814ab0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:09.816718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 903/1789] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:09 2022] DELETE /identity/v3/users/340bc2a64f4340c791d3ab2590814ab0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:09.817618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:09.819120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:09.907737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254b36-c957-45a0-a458-63c39c4f27f7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.908249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50653-3c66-4b29-a95b-743005c294cc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:09.916718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.918280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.918561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.918846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] PATH_INFO: `/v3/projects/394bd146ed3940ef94adb458c5a49c80` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.920197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:09.920903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.921201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.921471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] PATH_INFO: `/v3/projects/5c56e7112bb14773a037f4aedd569edd/users/bb2b2fa73255451299db6db26145393d/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.923167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394bd146ed3940ef94adb458c5a49c80)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.925962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.927682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56e7112bb14773a037f4aedd569edd, user_id=bb2b2fa73255451299db6db26145393d, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:09.932138 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfda788-1f77-446f-ad1d-2b5c6f2fc39f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:09.945995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:09.956792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 887/1790] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:09 2022] PUT /identity/v3/projects/5c56e7112bb14773a037f4aedd569edd/users/bb2b2fa73255451299db6db26145393d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:09.959640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:09.960131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:09.960602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:09.990541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:09.992706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.012083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394bd146ed3940ef94adb458c5a49c80', 'request_id': 'req-3cbe2816-4ece-43c0-b06d-770f061817d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.026476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394bd146ed3940ef94adb458c5a49c80', 'request_id': 'req-3cbe2816-4ece-43c0-b06d-770f061817d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.035492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394bd146ed3940ef94adb458c5a49c80', 'request_id': 'req-3cbe2816-4ece-43c0-b06d-770f061817d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.051735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] The token cache is being invalidate because project 394bd146ed3940ef94adb458c5a49c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:10.052091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.052843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3cbe2816-4ece-43c0-b06d-770f061817d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.054783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 904/1791] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:09 2022] DELETE /identity/v3/projects/394bd146ed3940ef94adb458c5a49c80 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:10.056024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.056517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.056802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.069468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:10.093469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] MFA Rules not processed for user `bb2b2fa73255451299db6db26145393d`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:10.094853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.097399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 888/1792] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:10.099065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.103290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.122313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674725-9fbf-479c-bf11-9cc2f59f6c9d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:10.128736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:10.129432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.129731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.130059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] PATH_INFO: `/v3/users/f1e54c8f620f4177998d69901548a74c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.131402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e54c8f620f4177998d69901548a74c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:10.134006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:10.260722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 905/1793] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:10.264990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.265920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.266218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e54c8f620f4177998d69901548a74c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.266932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e54c8f620f4177998d69901548a74c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.267666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e54c8f620f4177998d69901548a74c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.297065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e54c8f620f4177998d69901548a74c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.321057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e54c8f620f4177998d69901548a74c'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.349399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 889/1794] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:10 2022] DELETE /identity/v3/users/f1e54c8f620f4177998d69901548a74c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:10.350606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.352403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.474100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585252ea-f0a7-44bb-a5f6-6de47ddd8f1a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:10.491329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b614961-316a-418e-ac5c-f5d90d21502e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:10.504669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:10.505709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.505709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.505932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.507954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.595955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:10.627666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:10.628504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.629948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.629948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.635115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.658720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:10.661237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:10.707260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 890/1795] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:10.722937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.725390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.778833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:10.822051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:10.823743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:10.838021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 906/1796] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:10.881509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.893113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081001-917c-458a-9533-e6fe2a4eeced service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:10.898508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b0ca-4dfb-4752-8fca-efa4119d04d5 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:10.899694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:10.900531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.901002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.901287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] PATH_INFO: `/v3/projects/3d28427a94164693948b463ba458982f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.902666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d28427a94164693948b463ba458982f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:10.902840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:10.903474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:10.903765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:10.904045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:10.905396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:10.908315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.965063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d28427a94164693948b463ba458982f', 'request_id': 'req-e351cc2f-90b7-4995-8929-0c8959a969b5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:10.984180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d28427a94164693948b463ba458982f', 'request_id': 'req-e351cc2f-90b7-4995-8929-0c8959a969b5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:11.000706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d28427a94164693948b463ba458982f', 'request_id': 'req-e351cc2f-90b7-4995-8929-0c8959a969b5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:11.010514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.012073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc00e7-f2be-4ae5-b48f-001e33c00f61 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.031103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] The token cache is being invalidate because project 3d28427a94164693948b463ba458982f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:11.031655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:11.032308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 907/1797] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:11.035556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e351cc2f-90b7-4995-8929-0c8959a969b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:11.040237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 891/1798] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:10 2022] DELETE /identity/v3/projects/3d28427a94164693948b463ba458982f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:11.050959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.051589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.052071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.080192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:11.081673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:11.171282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 908/1799] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:11.173050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.173349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.173636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.203435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:11.204719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:11.222598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 892/1800] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:11.224037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.252945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8bf24-925b-4736-9c61-83e38d682507 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.265032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.265709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.266036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.268642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.269466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:11.269833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.273681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.319790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 909/1801] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:11.321261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.344887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45e72-10f6-4bd8-82f3-bd9955e821cb None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.354857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.356147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.356641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.357298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.358188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.361153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.446709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 893/1802] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:11 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:11.453159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.474490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7257-a82a-4597-8847-45ec2b94b8ce admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.490683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:11.620465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.625832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.626842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.628014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.630723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.633319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.687190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 910/1803] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:11 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:11.687897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.703420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995e3-ddc3-47fb-b4a1-15ff31c71e3b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.712347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.713290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.713677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.714663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.715485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.718308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.739079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 894/1804] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:11.744044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.755001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e981b5-c5b6-436f-91dc-55863e6fa588 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.761626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.762311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.762602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.764109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.764960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.766620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d0e22-9cae-44ba-9568-a8699678abcb admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.779758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 911/1805] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:11.783475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:11.797094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051b52-8ccd-4278-bbf6-b8cfb368c0f1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.807538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.809812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.810501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.811622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] PATH_INFO: `/v3/projects/bfd0c22b5e4f4dd18772b928453cc861/users/9f7dc9d744d043978ed2a69295333cf2/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.860086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd0c22b5e4f4dd18772b928453cc861, user_id=9f7dc9d744d043978ed2a69295333cf2, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.863311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.902579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 895/1806] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:11 2022] PUT /identity/v3/projects/bfd0c22b5e4f4dd18772b928453cc861/users/9f7dc9d744d043978ed2a69295333cf2/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:11.905911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.906104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.906376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.958314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] MFA Rules not processed for user `9f7dc9d744d043978ed2a69295333cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:11.960351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.073067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 912/1807] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:12.090474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.093148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.120495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.122690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.197136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:12.225104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556510-9cc7-4407-8e12-40e046f1f22f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:12.234796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:12.237074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.238581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.238998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.256732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:12.260487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aa27d-8304-47a3-b75d-9115987edfed service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:12.266818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc23b-3ad3-46bb-89f1-dc422f502d20 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:12.273894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:12.275344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.275843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.276939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] PATH_INFO: `/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.279308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b5c7b2248942efb3fdeba210c9ecda)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:12.280747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 896/1808] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:12.282094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:12.321400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:12.401619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b5c7b2248942efb3fdeba210c9ecda', 'request_id': 'req-f3f27676-a783-4170-9cb4-869b009c4045'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.416288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b5c7b2248942efb3fdeba210c9ecda', 'request_id': 'req-f3f27676-a783-4170-9cb4-869b009c4045'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.428507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b5c7b2248942efb3fdeba210c9ecda', 'request_id': 'req-f3f27676-a783-4170-9cb4-869b009c4045'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.443744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] The token cache is being invalidate because project f7b5c7b2248942efb3fdeba210c9ecda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:12.444058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.444784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.446720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 913/1809] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:12 2022] DELETE /identity/v3/projects/f7b5c7b2248942efb3fdeba210c9ecda => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:12.451684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8d9f-acc3-4349-9aeb-179aefc2d261 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.453462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8d9f-acc3-4349-9aeb-179aefc2d261 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.454160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8d9f-acc3-4349-9aeb-179aefc2d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.481917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-765b8d9f-acc3-4349-9aeb-179aefc2d261 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:12.484353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-765b8d9f-acc3-4349-9aeb-179aefc2d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.595798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.602341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.659579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 897/1810] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:12.674106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.674464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.676793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.721928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27676-a783-4170-9cb4-869b009c4045 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:12.728615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:12.729705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.730300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.730985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] PATH_INFO: `/v3/projects/80d8d2fd48c4446eb03b55bcd778374a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.731122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:12.732784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:12.733257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d8d2fd48c4446eb03b55bcd778374a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:12.736498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:12.762569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 898/1811] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:12.769109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.787861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0676-a86c-4c15-8185-e2b2c766ad3f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:12.812836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:12.815600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:12.815947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:12.816858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:12.818653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:12.819007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:12.830534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:12.875500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 899/1812] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:53:12.879196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d8d2fd48c4446eb03b55bcd778374a', 'request_id': 'req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.880334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.919570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d8d2fd48c4446eb03b55bcd778374a', 'request_id': 'req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.922334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4801a3-8794-42ee-b910-97de6d91316c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:12.947632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d8d2fd48c4446eb03b55bcd778374a', 'request_id': 'req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.975671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] The token cache is being invalidate because project 80d8d2fd48c4446eb03b55bcd778374a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:12.976337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.977729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:12.984349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 914/1813] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:12 2022] DELETE /identity/v3/projects/80d8d2fd48c4446eb03b55bcd778374a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:12.989095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:12.991942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:13.025390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.026303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.026600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.027681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.028372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.030867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.092637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:13.096158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 900/1814] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:12 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:13.102559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:13.107704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:13.153795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385dc00-ede2-4cfa-a9b3-839a91dc0cab admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:13.283139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:13.332856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee06e-ad8a-44eb-a5e6-1d16e3e236ae admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:13.340428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.341065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.341368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.341695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] PATH_INFO: `/v3/users/9b186983d4a044959a48d448f7f8469b` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.346828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b186983d4a044959a48d448f7f8469b)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.349528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.350225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.350515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.350861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.352131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.354815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.362283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.418213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 901/1815] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:13 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:13.425237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:13.451550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66bb3d-e870-4d31-8fd0-e38f8a28f9c9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:13.462266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.463284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.463851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.464186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.465071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.467942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.493946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 902/1816] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:13.499958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:13.506786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b186983d4a044959a48d448f7f8469b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:13.508498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b186983d4a044959a48d448f7f8469b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:13.520745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97e00-7ce4-4647-80a5-3ad6ce9e9eed admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:13.528208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.529963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.530500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.530987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.531910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.534586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.546437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b186983d4a044959a48d448f7f8469b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:13.548034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b186983d4a044959a48d448f7f8469b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:13.573737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a7312319-2240-44e2-ab90-5bc3c4257b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b186983d4a044959a48d448f7f8469b'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:13.611772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 903/1817] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:13.618441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:13.626668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 915/1818] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:12 2022] DELETE /identity/v3/users/9b186983d4a044959a48d448f7f8469b => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:13.627974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:13.656324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552adb-32b5-4384-bd53-1b0f62cd3a83 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:13.802320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:13.803899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.804298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.804755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] PATH_INFO: `/v3/projects/2bf9073527654e70ad1a162e47f420f6/users/92d7daa73d454d49a14550da85fbdb3f/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.834831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf9073527654e70ad1a162e47f420f6, user_id=92d7daa73d454d49a14550da85fbdb3f, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:13.837659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:13.881745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 904/1819] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:13 2022] PUT /identity/v3/projects/2bf9073527654e70ad1a162e47f420f6/users/92d7daa73d454d49a14550da85fbdb3f/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:13.893635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:13.893959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:13.894359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:13.980130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] MFA Rules not processed for user `92d7daa73d454d49a14550da85fbdb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:13.983059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:14.145796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:14.156262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 916/1820] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:14.166141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:14.354887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc82057-a3d0-4641-9f75-49b18e9a3f01 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:14.365063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:14.365711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:14.366022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:14.366302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:14.367262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:14.368913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:14.441831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 905/1821] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:14 2022] POST /identity/v3/projects => generated 363 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:14.444105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:14.511091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5bcc6-b74f-4494-9615-cb1ce2cb753c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:14.782710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:14.784627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:14.784627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:14.784951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:14.785847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:14.793828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:14.879874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 917/1822] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:14 2022] POST /identity/v3/users => generated 288 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:14.881677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:14.902455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3999-5dbd-4947-9191-59022aed8158 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:14.944624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:14.950621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:14.955559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:14.963256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:14.967660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:14.973717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.018658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 906/1823] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:15.020514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.050121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57349-ba75-4c10-8f45-0d2c072518aa admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.068625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.071472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.073086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.074145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] PATH_INFO: `/v3/projects/08761d7c68664dc1b0197bbcb51d4f96/users/d11980db4d164c1989df325907f38b7f/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.105341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.109133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.170248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08761d7c68664dc1b0197bbcb51d4f96, user_id=d11980db4d164c1989df325907f38b7f, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.180927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f36-6938-4f07-9841-3c78ee1d8b71 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.183912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.215632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.219852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.221316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.224732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] PATH_INFO: `/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.230665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e886d8afd2f45b58c31a76d14cc24e5)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.234404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.258395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 918/1824] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:15 2022] PUT /identity/v3/projects/08761d7c68664dc1b0197bbcb51d4f96/users/d11980db4d164c1989df325907f38b7f/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:15.264448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.287201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:15.397037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e886d8afd2f45b58c31a76d14cc24e5', 'request_id': 'req-4f866af0-9a8b-434a-9be9-2e9019314bbf'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.413371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e886d8afd2f45b58c31a76d14cc24e5', 'request_id': 'req-4f866af0-9a8b-434a-9be9-2e9019314bbf'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.434592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e886d8afd2f45b58c31a76d14cc24e5', 'request_id': 'req-4f866af0-9a8b-434a-9be9-2e9019314bbf'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.505201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] The token cache is being invalidate because project 1e886d8afd2f45b58c31a76d14cc24e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:15.505503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.506390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4f866af0-9a8b-434a-9be9-2e9019314bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.512591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 907/1825] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:15 2022] DELETE /identity/v3/projects/1e886d8afd2f45b58c31a76d14cc24e5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:15.514579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b17a-3608-422c-9546-2c0b6a4dace4 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.514874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b17a-3608-422c-9546-2c0b6a4dace4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.515153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b17a-3608-422c-9546-2c0b6a4dace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.557703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ffb1b17a-3608-422c-9546-2c0b6a4dace4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:15.559227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ffb1b17a-3608-422c-9546-2c0b6a4dace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.570092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581101d9-2222-409c-94ec-95d6b5c62bb3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.718567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.720546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.720913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.722076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.727160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.728529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.740222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 908/1826] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:15.744935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6987-053a-4c50-a4bb-a8efc860da17 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.745432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6987-053a-4c50-a4bb-a8efc860da17 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.745955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6987-053a-4c50-a4bb-a8efc860da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.775377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 919/1827] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:15.781908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.786002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.824475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8bf53-a788-40d3-affe-1c9e9a36e28b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.838818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.839515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.839722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-38ab6987-053a-4c50-a4bb-a8efc860da17 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:15.839933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.840080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] PATH_INFO: `/v3/projects/08761d7c68664dc1b0197bbcb51d4f96/users/d11980db4d164c1989df325907f38b7f/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.844391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-38ab6987-053a-4c50-a4bb-a8efc860da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.844589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08761d7c68664dc1b0197bbcb51d4f96, user_id=d11980db4d164c1989df325907f38b7f, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.856494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.859403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:15.900749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 920/1828] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:15 2022] PUT /identity/v3/projects/08761d7c68664dc1b0197bbcb51d4f96/users/d11980db4d164c1989df325907f38b7f/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:15.901268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 909/1829] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:15.901703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.905197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.905712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.907089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.039724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] MFA Rules not processed for user `d11980db4d164c1989df325907f38b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:16.046039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:16.048542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909f9b9-a0ec-4fd6-9cad-0b40164076e4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.072166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.072921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.073470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.073963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.074642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:16.074957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.076657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.093192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 921/1830] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:16.097252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.120070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690e2c-5e78-4979-8012-c13dbebee6db admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.133727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.134487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.134842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.135193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.136620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.139853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.223625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 922/1831] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:16 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:16.230112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.269177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 910/1832] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:16.311745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.314033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:16.377868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:16.484551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f125189-7d73-4e3b-aa6e-3c4316459e58 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.505234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.506377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.506727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.507013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.507804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.515592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d17494-2632-4b55-8da2-764a0d92cb38 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.516925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.581357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 923/1833] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:16 2022] POST /identity/v3/users => generated 285 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:16.583114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.613368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c9f3-b1fd-4aa8-8918-6c46042f858c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.631440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.634418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.634418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.636480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.637384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.647115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.680993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 924/1834] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:16.683575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.692437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.693344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.695557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.696061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.709365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bca4b-9dcf-471d-8b25-f8bdebf44f8e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.725395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.727666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.728421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.730021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.730801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.735473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.776170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 925/1835] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:16.784602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.808412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed04de-b016-4fd1-9f18-0b0df300d222 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.822592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.823712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.823904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.824162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] PATH_INFO: `/v3/projects/63a7d7006c2d4882a89686c0103eeee9/users/fb2de4b1c96949d8a7ae4af61314c8ca/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.864923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a7d7006c2d4882a89686c0103eeee9, user_id=fb2de4b1c96949d8a7ae4af61314c8ca, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.867947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbacb-d9ea-49e5-80fd-de4f43760537 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.870224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.873014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.900283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 926/1836] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:16 2022] PUT /identity/v3/projects/63a7d7006c2d4882a89686c0103eeee9/users/fb2de4b1c96949d8a7ae4af61314c8ca/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:16.910736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 911/1837] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:16.912268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.912558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.912890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.945364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:16.959097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] MFA Rules not processed for user `fb2de4b1c96949d8a7ae4af61314c8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:16.967957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.019149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.031717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34d7f-a8cc-44c5-9deb-763cc3a3ca38 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.067767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 927/1838] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:17.073473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.122914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.123786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.124171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.125164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.126673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.167914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674771b7-913c-46c2-92db-1ce1a73d87b4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.172539 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:17.173960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.174599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.174930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.175292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.176291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.189793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.223759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.227438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.232848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 928/1839] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:17 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:17.236922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.249572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 912/1840] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:17.383795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465f56-27e0-4282-8cd9-072a872de939 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.401837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.402442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.408337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.408828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.410238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.413983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.421086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.425287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.461750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 929/1841] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:17 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:17.463720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.480051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dee7a-9ee5-4c30-a006-60f3c384157b service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.489194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.490296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.490743 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581fa1-ad0f-4d38-a98d-9d8b305a308f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.490872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.491627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] PATH_INFO: `/v3/users/9f7dc9d744d043978ed2a69295333cf2` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.493190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7dc9d744d043978ed2a69295333cf2)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.495775 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.515430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.517697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.517697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.518201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.519908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.523390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.552104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 930/1842] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:17.555392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.586760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:17.602204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6459-46f9-417a-a8b2-986af4843306 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.614145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.615454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.621016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.622059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] PATH_INFO: `/v3/projects/8c1657c35664434caafb35e6d911bf4a/users/59b2be7827444a6f8cb56b59780843a8/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.630660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7dc9d744d043978ed2a69295333cf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:17.632902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7dc9d744d043978ed2a69295333cf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:17.633983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7dc9d744d043978ed2a69295333cf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:17.666279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1657c35664434caafb35e6d911bf4a, user_id=59b2be7827444a6f8cb56b59780843a8, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.672074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.679485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7dc9d744d043978ed2a69295333cf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:17.697171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-380dcdde-742a-405e-b8ca-99d4bc75f518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7dc9d744d043978ed2a69295333cf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:17.701485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 931/1843] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:17 2022] PUT /identity/v3/projects/8c1657c35664434caafb35e6d911bf4a/users/59b2be7827444a6f8cb56b59780843a8/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:17.709749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.714659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.735735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 913/1844] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:17 2022] DELETE /identity/v3/users/9f7dc9d744d043978ed2a69295333cf2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:17.742084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.742671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.743101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.768740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:17.769902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.826932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35dee-5d77-4ef6-aa62-30683803acf3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.853750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 914/1845] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:17.866446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.868530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:17.915571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.916206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.916476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.916758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.918360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.920582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.949637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 932/1846] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:17.952212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:17.969116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:17.974011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708523-a6d5-4d75-881a-021725eb3b6d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.979722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24f60b-7e6f-4ee2-a207-0a553ca66000 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:17.982505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.983287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.984195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.984531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] PATH_INFO: `/v3/projects/8c1657c35664434caafb35e6d911bf4a/users/59b2be7827444a6f8cb56b59780843a8/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:17.987504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1657c35664434caafb35e6d911bf4a, user_id=59b2be7827444a6f8cb56b59780843a8, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:17.989818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:17.990706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:17.990860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:17.991006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86eb8f-3a19-474a-9d65-98881bd0536c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:17.991104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:18.009158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 933/1847] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:17 2022] PUT /identity/v3/projects/8c1657c35664434caafb35e6d911bf4a/users/59b2be7827444a6f8cb56b59780843a8/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:18.022293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:18.022469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:18.022827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:18.023403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:18.023911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:18.046409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 915/1848] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:18.064895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] MFA Rules not processed for user `59b2be7827444a6f8cb56b59780843a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:18.066172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:18.196706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:18.217346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 934/1849] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:18.240240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:18.242734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:18.347528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5c8b7-1734-4ce6-815e-2cc35c6b7650 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:18.463230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:18.464309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:18.464796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:18.465288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:18.478394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:18.480021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:18.505858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 916/1850] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:18.584466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:18.602998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049ea2-5715-4825-a4e7-edf859a83c58 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:18.612386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:18.613641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:18.614200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:18.614760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:18.618194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:18.806559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:18.810738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616976a-785c-4e0e-a372-597cbebdad00 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:18.832327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 935/1851] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:19.010835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:19.014262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:19.255436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f839-c116-4c9e-8d7f-2463f6343184 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:19.277424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:19.278643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:19.280258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:19.281438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] PATH_INFO: `/v3/projects/bfd0c22b5e4f4dd18772b928453cc861` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:19.285735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd0c22b5e4f4dd18772b928453cc861)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:19.295009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:19.489429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd0c22b5e4f4dd18772b928453cc861', 'request_id': 'req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:19.493747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:19.505155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd0c22b5e4f4dd18772b928453cc861', 'request_id': 'req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:19.527838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd0c22b5e4f4dd18772b928453cc861', 'request_id': 'req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:19.581829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] The token cache is being invalidate because project bfd0c22b5e4f4dd18772b928453cc861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:19.581829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:19.581829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ecfbda9-9eb3-48d2-ba7f-9aaec65c6dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:19.583424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 917/1852] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:19 2022] DELETE /identity/v3/projects/bfd0c22b5e4f4dd18772b928453cc861 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:19.591433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:19.592047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:19.592560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:19.626527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:19.630938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:19.822554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 936/1853] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:19.842756 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:19.843636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:19.844129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:19.887015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:19.889097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:19.911231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 918/1854] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:19.918511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:19.939067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888fb51-e5c5-4a2b-b07e-95c4067b3d0f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:19.944598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:19.945378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:19.946600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:19.946600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:19.947102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:19.947240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:19.949436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:19.977853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 937/1855] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:53:19.980532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.004697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63961b-e84f-42ab-83ab-402550946192 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.014520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.015666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.016324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.016904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.018183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.022434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.060426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.063929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.065182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 919/1856] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:19 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:20.072137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.086176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc0f3c-6b7c-4b98-84b7-3c8c4319f137 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.275145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.275724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695f33-9ed0-4535-9c91-39c7ef049025 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.276720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.277277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.277842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] PATH_INFO: `/v3/users/35949dc40ef74cdd9838c4fddd0ff23e` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.280380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35949dc40ef74cdd9838c4fddd0ff23e)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.285883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.294799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.295623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.296076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.296506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.297290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.299429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.360764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 920/1857] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:20 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:20.361990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.378768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4cfc9-77a1-45af-b06f-87a6f984224b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.385932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:20.388814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.389913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.391948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.392840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.395699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.402124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.445220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 921/1858] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:20.447522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.461259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35949dc40ef74cdd9838c4fddd0ff23e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:20.463944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e866-6388-4f7e-9859-5e6852872fba admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.464081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35949dc40ef74cdd9838c4fddd0ff23e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:20.472714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.473701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.474226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.474689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.476198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.480751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.508837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35949dc40ef74cdd9838c4fddd0ff23e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:20.510080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35949dc40ef74cdd9838c4fddd0ff23e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:20.517517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 922/1859] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:20.523403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.527017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fbb9e644-6eca-4f59-8c82-9d8a35421103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35949dc40ef74cdd9838c4fddd0ff23e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:20.528603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.577106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e5483-041b-484d-82a2-151d07eefe1a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.588044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.590442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.592677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.593415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] PATH_INFO: `/v3/projects/0d8c66c55dd84b88898124d109c2cba8/users/f83ad21779664cd7ad706c46e8add81f/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.601516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 938/1860] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:20 2022] DELETE /identity/v3/users/35949dc40ef74cdd9838c4fddd0ff23e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:20.608300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.608845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.614085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.621218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c66c55dd84b88898124d109c2cba8, user_id=f83ad21779664cd7ad706c46e8add81f, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.624235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2024ebd-54de-4d4d-ac1b-1e607e3e076b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.661044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 923/1861] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:20 2022] PUT /identity/v3/projects/0d8c66c55dd84b88898124d109c2cba8/users/f83ad21779664cd7ad706c46e8add81f/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:20.675393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:20.679197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.679570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.679843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.680236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.720309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] MFA Rules not processed for user `f83ad21779664cd7ad706c46e8add81f`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:20.721615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.790990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:20.791342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 939/1862] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:20.805522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.807854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.840858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 924/1863] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:20.860340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:20.862487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:20.911245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2b24-e9b8-476b-9d00-5fa543a79b58 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.918048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.920923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.922048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.922048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:20.946475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:20.946475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:20.974016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 940/1864] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:20.976654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0054-2954-4bbd-a789-da0f8a04a685 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:20.985185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:20.986310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:20.986854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:20.987401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:21.010911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:21.014634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:21.033107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 925/1865] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:21.493147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:21.495432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:21.542797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b584b-1b1c-4c9b-9a1a-2cf5a7742e0e service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:21.570768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:21.571321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:21.571619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:21.571918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] PATH_INFO: `/v3/projects/09e1e4cf79744e2faf5a790019f41e57` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:21.577446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e1e4cf79744e2faf5a790019f41e57)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:21.582361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:21.717702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:21.744969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e1e4cf79744e2faf5a790019f41e57', 'request_id': 'req-24cb19e6-600f-4a29-b58c-544c8dbadfbe'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:21.774212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e1e4cf79744e2faf5a790019f41e57', 'request_id': 'req-24cb19e6-600f-4a29-b58c-544c8dbadfbe'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:21.790477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e1e4cf79744e2faf5a790019f41e57', 'request_id': 'req-24cb19e6-600f-4a29-b58c-544c8dbadfbe'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:21.820655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] The token cache is being invalidate because project 09e1e4cf79744e2faf5a790019f41e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:21.822470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:21.824967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:21.829358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 941/1866] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:21 2022] DELETE /identity/v3/projects/09e1e4cf79744e2faf5a790019f41e57 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:21.834674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:21.871287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982c7cc-6152-40f9-be08-d18cfaa24a8f service glance] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:22.105909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:22.110169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:22.111241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:22.112083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] PATH_INFO: `/v3/users/bb2b2fa73255451299db6db26145393d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:22.116250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2b2fa73255451299db6db26145393d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:22.121939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:22.264842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2b2fa73255451299db6db26145393d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:22.266604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2b2fa73255451299db6db26145393d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:22.267594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2b2fa73255451299db6db26145393d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:22.314656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2b2fa73255451299db6db26145393d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:22.329441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2b2fa73255451299db6db26145393d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:22.357311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 926/1867] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:21 2022] DELETE /identity/v3/users/bb2b2fa73255451299db6db26145393d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:24.247748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:24.258303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.328277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb19e6-600f-4a29-b58c-544c8dbadfbe admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:24.465131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:24.468933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.486173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:24.509499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:24.510792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.511243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.511654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] PATH_INFO: `/v3/projects/5c56e7112bb14773a037f4aedd569edd` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.514526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56e7112bb14773a037f4aedd569edd)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:24.517884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:24.587481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca1a8-bd94-4bf3-b28d-24033650c386 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:24.596889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56e7112bb14773a037f4aedd569edd', 'request_id': 'req-19dea347-3865-4e08-b81c-bbdd318a47c4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.614967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56e7112bb14773a037f4aedd569edd', 'request_id': 'req-19dea347-3865-4e08-b81c-bbdd318a47c4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.642261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56e7112bb14773a037f4aedd569edd', 'request_id': 'req-19dea347-3865-4e08-b81c-bbdd318a47c4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.663003 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] The token cache is being invalidate because project 5c56e7112bb14773a037f4aedd569edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:24.663335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.664012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-19dea347-3865-4e08-b81c-bbdd318a47c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.665804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 942/1868] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:24 2022] DELETE /identity/v3/projects/5c56e7112bb14773a037f4aedd569edd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:24.671931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7c25-a3e9-4ba9-8e1c-ea9a330cb479 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.672426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7c25-a3e9-4ba9-8e1c-ea9a330cb479 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.673437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7c25-a3e9-4ba9-8e1c-ea9a330cb479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.705960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-58dc7c25-a3e9-4ba9-8e1c-ea9a330cb479 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:24.708292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:24.708458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-58dc7c25-a3e9-4ba9-8e1c-ea9a330cb479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.709205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.709205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.709620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] PATH_INFO: `/v3/users/fb2de4b1c96949d8a7ae4af61314c8ca` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.715767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2de4b1c96949d8a7ae4af61314c8ca)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:24.720416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:24.769461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 943/1869] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:24.772470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.773203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.773963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.834109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:24.834109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.846701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 944/1870] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:24.852142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2de4b1c96949d8a7ae4af61314c8ca'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.853372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2de4b1c96949d8a7ae4af61314c8ca'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.854163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:24.854489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2de4b1c96949d8a7ae4af61314c8ca'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.876353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facbc3c-7066-466f-8991-2c7a437ca955 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:24.884634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:24.885699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.885918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2de4b1c96949d8a7ae4af61314c8ca'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.886264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.886746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.888541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:24.889084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:24.892224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:24.910221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fc735704-cc99-4f89-95e1-6317f99a9370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2de4b1c96949d8a7ae4af61314c8ca'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:24.948449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 945/1871] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:24.948712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 927/1872] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:24 2022] DELETE /identity/v3/users/fb2de4b1c96949d8a7ae4af61314c8ca => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:24.951291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:24.951620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:24.951890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:24.955752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:24.962270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.990999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:24.991427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:24.999447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e1c73-6c22-443b-bd45-f00b2fb6e4e7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.058044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:25.099961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:25.165369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 928/1873] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:25.180753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:25.184052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:25.187138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.188225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.188740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.189259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.190513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.194934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.267300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 946/1874] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:24 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:25.272555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:25.325960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bce17-9ad7-4fff-bc54-70c76041ea7f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.387970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.388828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.389277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.389728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.404519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe45ae-5b97-4cff-94f3-782c79ff14a0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.406728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.408685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.414247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.415445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.415994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.416507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.417890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.423525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.427991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 929/1875] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:25.462750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 947/1876] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:25 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:25.464459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:25.480622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770544c-0941-456b-9ce0-5ce997e5f52c service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.487288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.487914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.488228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.488500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.489147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.490807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.506377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 930/1877] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:25.512103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:25.527773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633fbc-a592-44a1-8441-7ae07013fa7c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.543608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.545423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.545630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.546425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.558805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.561808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09cf08-4fc2-42f6-9b8c-1b3b8757c460 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.626455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 948/1878] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:25.633806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:25.670310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65ca55-19cd-4aba-adac-4d64261a7f81 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:25.688827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:25.690074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.690629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.691167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] PATH_INFO: `/v3/projects/8f3064e907634ffea86061a1fe77a567/users/990e5d3e01c54089a7042ffeb6a52e1f/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.721465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3064e907634ffea86061a1fe77a567, user_id=990e5d3e01c54089a7042ffeb6a52e1f, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:25.730105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:25.764840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 931/1879] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:25 2022] PUT /identity/v3/projects/8f3064e907634ffea86061a1fe77a567/users/990e5d3e01c54089a7042ffeb6a52e1f/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:25.784637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:25.785126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:25.785617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:25.905656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] MFA Rules not processed for user `990e5d3e01c54089a7042ffeb6a52e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:25.907060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.074016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 949/1880] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:26.080315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.159938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.162775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.224259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.229012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b1d7-7f86-4b99-8b54-3d3e8e05aea5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.236467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.237101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.237386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.237663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.238848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.244843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.254937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.332333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 932/1881] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:26 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:26.339359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.344613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b66dc-1c2d-49ec-948d-71366be516e8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.476054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.476719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.477209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.477830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] PATH_INFO: `/v3/projects/63a7d7006c2d4882a89686c0103eeee9` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.478078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707f40-475e-4908-8dfe-c451ea89f6a5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.480209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a7d7006c2d4882a89686c0103eeee9)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.485839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.486598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.487903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.488481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.489053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.489953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.492395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.525397 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 933/1882] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:26 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:26.532055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.561074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf4d4-0686-4dc5-bf8a-d1029944afa8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.600026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a7d7006c2d4882a89686c0103eeee9', 'request_id': 'req-99adee19-313d-45b9-9d83-ae9df07c46d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.613305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a7d7006c2d4882a89686c0103eeee9', 'request_id': 'req-99adee19-313d-45b9-9d83-ae9df07c46d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.627912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a7d7006c2d4882a89686c0103eeee9', 'request_id': 'req-99adee19-313d-45b9-9d83-ae9df07c46d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.649023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] The token cache is being invalidate because project 63a7d7006c2d4882a89686c0103eeee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:26.649520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.651161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.657495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 950/1883] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:26 2022] DELETE /identity/v3/projects/63a7d7006c2d4882a89686c0103eeee9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:26.657696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.659066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.683863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.684181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.684477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.684810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.685630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.687325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.704402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 934/1884] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:26.706321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.710476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.740391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afd30-872b-48de-b432-a8fa78b9d07e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.749365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.750328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.750768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.751063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] PATH_INFO: `/v3/projects/5507e51c9c3543178e414ff441a292d4/users/fab246dd13e94ccf8d2882c27be8491d/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.770859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adee19-313d-45b9-9d83-ae9df07c46d6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.780762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.781989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.782703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.783254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] PATH_INFO: `/v3/users/59b2be7827444a6f8cb56b59780843a8` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.785889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b2be7827444a6f8cb56b59780843a8)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.789539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.794868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.806308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5507e51c9c3543178e414ff441a292d4, user_id=fab246dd13e94ccf8d2882c27be8491d, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.811207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.842805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 935/1885] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:26 2022] PUT /identity/v3/projects/5507e51c9c3543178e414ff441a292d4/users/fab246dd13e94ccf8d2882c27be8491d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:26.849143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.904966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b2be7827444a6f8cb56b59780843a8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.906054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b2be7827444a6f8cb56b59780843a8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.934428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b2be7827444a6f8cb56b59780843a8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.936239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b2be7827444a6f8cb56b59780843a8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.940598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.959385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b2be7827444a6f8cb56b59780843a8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:26.980144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38f72-c0aa-4304-a44c-bbaa2ae43b06 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.989230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.989900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.990164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 951/1886] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:26 2022] DELETE /identity/v3/users/59b2be7827444a6f8cb56b59780843a8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:26.990299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.990540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.991631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.994129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a48a66-e042-4844-94a2-49ffe7857b13 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:27.022011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 936/1887] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:27.025673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:27.029064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:27.177721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb002b1-2d73-4d18-858b-78deba6a641e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:27.183124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:27.184279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:27.185360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:27.186925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] PATH_INFO: `/v3/projects/5507e51c9c3543178e414ff441a292d4/users/fab246dd13e94ccf8d2882c27be8491d/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:27.189937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5507e51c9c3543178e414ff441a292d4, user_id=fab246dd13e94ccf8d2882c27be8491d, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:27.201008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:27.237908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 952/1888] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:27 2022] PUT /identity/v3/projects/5507e51c9c3543178e414ff441a292d4/users/fab246dd13e94ccf8d2882c27be8491d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:27.241837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:27.242338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:27.242812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:27.302457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] MFA Rules not processed for user `fab246dd13e94ccf8d2882c27be8491d`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:27.305870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:27.548177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 937/1889] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:27.582778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:27.587748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:27.590014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:27.594227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:27.755906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3441ac-aabb-47d8-857d-c407eb26527e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:27.763830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:27.776653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:27.777153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:27.778430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:27.800679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:27.802784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:27.834521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 938/1890] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:27.841018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:27.848052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:27.880960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bb11-ded5-4e2c-b870-00f464d14efc admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:27.895857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abeb9d-6bac-4660-9b74-32a47fbcdcf3 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:27.900574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:27.901247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:27.901534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:27.902945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] PATH_INFO: `/v3/users/92d7daa73d454d49a14550da85fbdb3f` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:27.904880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d7daa73d454d49a14550da85fbdb3f)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:27.914575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:27.915197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:27.917247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:27.918966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:27.919425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] PATH_INFO: `/v3/projects/8c1657c35664434caafb35e6d911bf4a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:27.925132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1657c35664434caafb35e6d911bf4a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:27.932072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:27.976218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:28.074263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d7daa73d454d49a14550da85fbdb3f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.076573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d7daa73d454d49a14550da85fbdb3f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.078690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1657c35664434caafb35e6d911bf4a', 'request_id': 'req-92e0020e-7484-4d16-8708-310d58312b0d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.089146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1657c35664434caafb35e6d911bf4a', 'request_id': 'req-92e0020e-7484-4d16-8708-310d58312b0d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.099305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1657c35664434caafb35e6d911bf4a', 'request_id': 'req-92e0020e-7484-4d16-8708-310d58312b0d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.102111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:28.125285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] The token cache is being invalidate because project 8c1657c35664434caafb35e6d911bf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:28.125695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.126629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-92e0020e-7484-4d16-8708-310d58312b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.128621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 939/1891] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:27 2022] DELETE /identity/v3/projects/8c1657c35664434caafb35e6d911bf4a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:28.138326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955ccf-63a9-484e-80e8-db5ed48cc86b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.138985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955ccf-63a9-484e-80e8-db5ed48cc86b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.141690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955ccf-63a9-484e-80e8-db5ed48cc86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.146476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d7daa73d454d49a14550da85fbdb3f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.151473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d7daa73d454d49a14550da85fbdb3f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.167914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3d0da38a-b752-47bc-9206-905def1f32e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d7daa73d454d49a14550da85fbdb3f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:28.194511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 953/1892] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:27 2022] DELETE /identity/v3/users/92d7daa73d454d49a14550da85fbdb3f => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:28.199996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-71955ccf-63a9-484e-80e8-db5ed48cc86b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:28.202740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.203237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.203722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.204922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-71955ccf-63a9-484e-80e8-db5ed48cc86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:28.288638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:28.295859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:28.423578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 940/1893] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:28.433717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.434294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.435524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.444134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 954/1894] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:28.459846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:28.461533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:28.501847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:28.506117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:28.538490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 941/1895] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:28.542383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:28.583260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3dd46-94db-4422-888a-7bcf5ea039b7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:28.609343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:28.610150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3386414-8dc2-43fc-8858-db771fe380d9 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:28.610958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.611750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.612240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.613481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:28.614160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:28.615198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:28.615831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.616118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.616402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.617843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:28.635928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:28.638245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:28.647951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 942/1896] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:28.649186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:28.650857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 955/1897] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:28.666677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a67dbf-ab1e-4f96-88fd-9caac690a4ac admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:28.676180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:28.677218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.677923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.678392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.679475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:28.683317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:28.737291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 943/1898] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:28 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:28.742342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:28.773757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a9af-5798-4af6-b524-47be93dfbd99 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:28.857162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:28.929161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:28.929161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:28.929161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:28.929161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:28.930782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:28.938172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:28.988749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 956/1899] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:28 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:28.992900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.014663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a311bbd-883c-4b66-ac03-feb3c52d48e6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.022259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.023152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.023559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.024072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.025253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.027664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.052136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 944/1900] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:29.058721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.090421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9c1b-68e2-4e74-bce4-247d90c94ef1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.102624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.103545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.104177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.105331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.107257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.110765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.127217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.133074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.134512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 957/1901] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:29.143089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.166323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d8e8-3336-49bd-9566-4878ea6db96f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.176041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2152-d791-4a44-9b5f-beac5ddbcc35 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.183033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.185289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.185816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.186385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] PATH_INFO: `/v3/projects/469ee86e4e554bc28025b1c1a92e0885/users/aca4622f517e427c9b3679b3465eecd2/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.187755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.188772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.189229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.189711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] PATH_INFO: `/v3/users/990e5d3e01c54089a7042ffeb6a52e1f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.191724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=990e5d3e01c54089a7042ffeb6a52e1f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.195568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.218942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469ee86e4e554bc28025b1c1a92e0885, user_id=aca4622f517e427c9b3679b3465eecd2, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.223708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b39e0-88bd-44d1-ac7c-4f312f6fbb88 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.249527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 958/1902] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:29 2022] PUT /identity/v3/projects/469ee86e4e554bc28025b1c1a92e0885/users/aca4622f517e427c9b3679b3465eecd2/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:29.264554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.264554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.264554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.291460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990e5d3e01c54089a7042ffeb6a52e1f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.292337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990e5d3e01c54089a7042ffeb6a52e1f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.293415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990e5d3e01c54089a7042ffeb6a52e1f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.319688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] MFA Rules not processed for user `aca4622f517e427c9b3679b3465eecd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:29.321306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.333493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990e5d3e01c54089a7042ffeb6a52e1f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.368938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1f80d935-b3f5-4945-9aae-8f9a56c6b80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990e5d3e01c54089a7042ffeb6a52e1f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.391117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 945/1903] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:29 2022] DELETE /identity/v3/users/990e5d3e01c54089a7042ffeb6a52e1f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:29.396972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.397563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.398258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.449530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:29.452706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.464322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:29.471147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 959/1904] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:29.478641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.481737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.603362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 946/1905] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:29.606165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.609458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.624182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b4ba-ba84-492c-80db-c7774807e970 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.631761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.632810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.633243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.633693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] PATH_INFO: `/v3/projects/2bf9073527654e70ad1a162e47f420f6` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.638307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf9073527654e70ad1a162e47f420f6)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.638861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.644489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906584-317a-4f87-96f6-49e7cd9a4bb3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.659034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.660614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.661120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.663021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.663485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:29.670606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:29.672540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:29.721074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 947/1906] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:29 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:29.722278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.726686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.726912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf9073527654e70ad1a162e47f420f6', 'request_id': 'req-b58695df-50d7-496a-970b-4d1a37b52801'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.743032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf9073527654e70ad1a162e47f420f6', 'request_id': 'req-b58695df-50d7-496a-970b-4d1a37b52801'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.755611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf9073527654e70ad1a162e47f420f6', 'request_id': 'req-b58695df-50d7-496a-970b-4d1a37b52801'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.779748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] The token cache is being invalidate because project 2bf9073527654e70ad1a162e47f420f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:29.780707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.782145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:29.788358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 960/1907] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:29 2022] DELETE /identity/v3/projects/2bf9073527654e70ad1a162e47f420f6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:29.788358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:29.790569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.891810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98274e-6b05-4129-96cf-1cdc13c73a15 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:29.898171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:29.899022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:29.899477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:29.899912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:29.903407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:29.914971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58695df-50d7-496a-970b-4d1a37b52801 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.026552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.027467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.028691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.029195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.030357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.034211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.035761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.037488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.056989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 948/1908] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:30.059717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.062215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:30.080681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 961/1909] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:29 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:30.083027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.085556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf464-4400-4634-ada2-0e4d411218e7 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.094776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.095922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.096426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.096917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] PATH_INFO: `/v3/users/d11980db4d164c1989df325907f38b7f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.099386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11980db4d164c1989df325907f38b7f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.101435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81869522-d6c0-4eef-9a8f-ab6f25b9e4d9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.103601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.111642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.112725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.113235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.113741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.115765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.118282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.139773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 962/1910] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:30.154066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.179175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ed16-a20c-474f-97bb-219d33d03dd0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.189188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.190832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.191869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:30.192177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.192737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] PATH_INFO: `/v3/projects/f5de82dcbe404853976eb1b066d9743c/users/72e614d57d6a4a6a8ea43e2ff31100d7/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.220534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11980db4d164c1989df325907f38b7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:30.222178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5de82dcbe404853976eb1b066d9743c, user_id=72e614d57d6a4a6a8ea43e2ff31100d7, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.223784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11980db4d164c1989df325907f38b7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:30.225043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11980db4d164c1989df325907f38b7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:30.235540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.254735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11980db4d164c1989df325907f38b7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:30.259799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 963/1911] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:30 2022] PUT /identity/v3/projects/f5de82dcbe404853976eb1b066d9743c/users/72e614d57d6a4a6a8ea43e2ff31100d7/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:30.265488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.267994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:30.271543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11980db4d164c1989df325907f38b7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:30.302407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:30.313481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 949/1912] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:30 2022] DELETE /identity/v3/users/d11980db4d164c1989df325907f38b7f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:30.435672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358788-1c2e-47dd-a962-09ca9bdbc55b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.588050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.589127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.589691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.590240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.591864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.593945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.615865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 964/1913] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:30.620665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.644573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8afd2-50b3-4c81-a3ce-95ad6fbb3c71 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.673336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.677688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.680518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.680518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] PATH_INFO: `/v3/projects/f5de82dcbe404853976eb1b066d9743c/users/72e614d57d6a4a6a8ea43e2ff31100d7/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.690150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5de82dcbe404853976eb1b066d9743c, user_id=72e614d57d6a4a6a8ea43e2ff31100d7, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.698720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863646c-4a6e-4361-b23d-f5329ad604be admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:30.754691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:30.755728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 950/1914] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:30 2022] PUT /identity/v3/projects/f5de82dcbe404853976eb1b066d9743c/users/72e614d57d6a4a6a8ea43e2ff31100d7/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:30.759004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:30.774228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.774628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.775024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.783964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a396a56-4d12-41db-ac82-5699768aa4c4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:30.828348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] MFA Rules not processed for user `72e614d57d6a4a6a8ea43e2ff31100d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:30.831037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:30.942819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:30.943863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:30.944331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:30.945054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] PATH_INFO: `/v3/projects/8f3064e907634ffea86061a1fe77a567` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:30.947930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3064e907634ffea86061a1fe77a567)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:30.956601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:31.040137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 951/1915] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:31.041406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:31.043372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.073816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df31e22-7ec1-4655-b121-82c203d77e87 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:31.099604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3064e907634ffea86061a1fe77a567', 'request_id': 'req-358d0859-3e72-4edc-8ca2-e24c39f335e9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.128126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3064e907634ffea86061a1fe77a567', 'request_id': 'req-358d0859-3e72-4edc-8ca2-e24c39f335e9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.130023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:31.150585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3064e907634ffea86061a1fe77a567', 'request_id': 'req-358d0859-3e72-4edc-8ca2-e24c39f335e9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.189302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] The token cache is being invalidate because project 8f3064e907634ffea86061a1fe77a567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:31.190496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.192088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.196864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 965/1916] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:30 2022] DELETE /identity/v3/projects/8f3064e907634ffea86061a1fe77a567 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:31.198948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:31.202563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.234674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:31.236576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.237379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.237966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] PATH_INFO: `/v3/projects/08761d7c68664dc1b0197bbcb51d4f96` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.240673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08761d7c68664dc1b0197bbcb51d4f96)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:31.253875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:31.304207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:31.341389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0859-3e72-4edc-8ca2-e24c39f335e9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:31.367391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08761d7c68664dc1b0197bbcb51d4f96', 'request_id': 'req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.382620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08761d7c68664dc1b0197bbcb51d4f96', 'request_id': 'req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.396214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08761d7c68664dc1b0197bbcb51d4f96', 'request_id': 'req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.422656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] The token cache is being invalidate because project 08761d7c68664dc1b0197bbcb51d4f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:31.423140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.424601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.427920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 952/1917] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:31 2022] DELETE /identity/v3/projects/08761d7c68664dc1b0197bbcb51d4f96 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:31.430464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:31.432329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.447520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:31.448857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.449378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.449900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.453436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.605703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24cd3e-ddc6-414e-8cb5-53b12306bae7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:31.614971 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:31.616534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.616534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.616994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] PATH_INFO: `/v3/users/fab246dd13e94ccf8d2882c27be8491d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.625820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab246dd13e94ccf8d2882c27be8491d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:31.625820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:31.627163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:31.631131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7169d-a433-4397-9139-ab1d9ae93dba service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:31.651442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 966/1918] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:31.653666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69db3-5300-4a94-a3d5-01a7a63d1275 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.654238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69db3-5300-4a94-a3d5-01a7a63d1275 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.654654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69db3-5300-4a94-a3d5-01a7a63d1275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.688393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-28f69db3-5300-4a94-a3d5-01a7a63d1275 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:31.689628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-28f69db3-5300-4a94-a3d5-01a7a63d1275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.694963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab246dd13e94ccf8d2882c27be8491d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.695666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab246dd13e94ccf8d2882c27be8491d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.696855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab246dd13e94ccf8d2882c27be8491d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.699539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 967/1919] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:31.708647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.708647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.708647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.723644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab246dd13e94ccf8d2882c27be8491d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.729750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:31.731692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:31.738055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab246dd13e94ccf8d2882c27be8491d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:31.756030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 953/1920] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:31 2022] DELETE /identity/v3/users/fab246dd13e94ccf8d2882c27be8491d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:31.767597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:31.768175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 968/1921] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:31.854949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:31.943303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb98fdf-eb3e-4022-9b19-4b4593742fb0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:31.953448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:31.954308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:31.963796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:31.964851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:31.976207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:31.976654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:31.979843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.006004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 954/1922] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:32.011019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.027622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d4a52-bef7-407e-9f91-2b3b509c8615 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:32.037705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:32.038783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.039277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.039873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.041201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:32.044779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.116615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.117315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 969/1923] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:32 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:32.145355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39027c6-22b1-4528-9b43-1c750a8ad3da admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:32.283374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:32.284633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.285162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.285676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.287005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:32.291352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.343200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 955/1924] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:32 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:32.349299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.380493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f10bc-ae5f-42ce-9a86-cbd02acc801e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:32.431652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:32.432611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.433124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.433641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.436911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:32.439853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.457576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 970/1925] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:32.464012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.494084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823094-0f15-401c-a561-f3cac82a0176 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:32.509969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:32.514232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.515311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.516135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.518040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:32.522914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c92505-daeb-4987-a142-c689693d262b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.560793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 956/1926] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:32.562694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.578039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aafd5-4447-4027-b720-00208600dc98 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:32.583951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:32.584719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.585055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.585342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] PATH_INFO: `/v3/projects/7387d786adfa4c8d89496fed25bff427/users/08416a3396eb4fbf8dd7f19b2a7c9d5a/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.591987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:32.621133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7387d786adfa4c8d89496fed25bff427, user_id=08416a3396eb4fbf8dd7f19b2a7c9d5a, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:32.624648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:32.670485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 971/1927] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:32 2022] PUT /identity/v3/projects/7387d786adfa4c8d89496fed25bff427/users/08416a3396eb4fbf8dd7f19b2a7c9d5a/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:32.674964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:32.676187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:32.676474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:32.738942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] MFA Rules not processed for user `08416a3396eb4fbf8dd7f19b2a7c9d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:32.740513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:32.875327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 957/1928] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:32.893890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:32.898321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.067334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d593713-e89f-4af6-b3fd-7892c8c98974 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:33.073649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:33.075668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.076194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.076670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.087745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:33.089590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:33.100307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 972/1929] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:33.131209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:33.210479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:33.234801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:33.236881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.277816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f32b8-6a5b-412e-a762-9be428e2c6d1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:33.290850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:33.291697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.292061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.292535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] PATH_INFO: `/v3/users/08416a3396eb4fbf8dd7f19b2a7c9d5a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.294644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08416a3396eb4fbf8dd7f19b2a7c9d5a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:33.298183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:33.359246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f802c-3b21-4e87-a0bf-aa7a9af6270b service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:33.368204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:33.369490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.369866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.370299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] PATH_INFO: `/v3/projects/5507e51c9c3543178e414ff441a292d4` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.371992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5507e51c9c3543178e414ff441a292d4)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:33.375066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:33.415012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08416a3396eb4fbf8dd7f19b2a7c9d5a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.416693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08416a3396eb4fbf8dd7f19b2a7c9d5a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.418165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08416a3396eb4fbf8dd7f19b2a7c9d5a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.498389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5507e51c9c3543178e414ff441a292d4', 'request_id': 'req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.505256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5507e51c9c3543178e414ff441a292d4', 'request_id': 'req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.513658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5507e51c9c3543178e414ff441a292d4', 'request_id': 'req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.515716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08416a3396eb4fbf8dd7f19b2a7c9d5a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.535552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b4b8664-6acc-4e19-943e-5039a073b159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08416a3396eb4fbf8dd7f19b2a7c9d5a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.544290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] The token cache is being invalidate because project 5507e51c9c3543178e414ff441a292d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:33.545354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.547176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:33.554538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 973/1930] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:33 2022] DELETE /identity/v3/projects/5507e51c9c3543178e414ff441a292d4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:33.554538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:33.555508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.570972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 958/1931] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:33 2022] DELETE /identity/v3/users/08416a3396eb4fbf8dd7f19b2a7c9d5a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:33.574198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b053-ed66-461b-950a-cfec560979fd None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.576028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b053-ed66-461b-950a-cfec560979fd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.576816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b053-ed66-461b-950a-cfec560979fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.603649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:33.615785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a836b053-ed66-461b-950a-cfec560979fd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:33.618489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a836b053-ed66-461b-950a-cfec560979fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.677084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ecba2-bb94-4fba-ae02-4e1cfba8ee84 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:33.726852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 959/1932] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:33.728620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedacbc8-5ef7-4b3e-9281-e0b1851a3946 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.729042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedacbc8-5ef7-4b3e-9281-e0b1851a3946 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.729389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedacbc8-5ef7-4b3e-9281-e0b1851a3946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.754597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-bedacbc8-5ef7-4b3e-9281-e0b1851a3946 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:33.756095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bedacbc8-5ef7-4b3e-9281-e0b1851a3946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.770967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 960/1933] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:33.770967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.770967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.770967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.800808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:33.804049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.816989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:33.817664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.817998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.820094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.823967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.827253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 961/1934] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:33.831551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:33.833530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:33.935874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:33.972571 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b40aba-c67d-48e9-addc-34f882dc696a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:33.981506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:33.982389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:33.982568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:33.982821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:33.999080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.000603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.037979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.042361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.046729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 962/1935] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:34.048212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.069205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 974/1936] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:34.084562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8733e-7131-4e52-a1ab-0a57aea7758a service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.106204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.109949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.110471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.110965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.114030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:34.116943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.119118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.153027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 963/1937] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:34.155561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.194410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a2166-e98e-47a7-bc17-382b45588fa2 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.213641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.215074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.218484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.219443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.221050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.224951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.339512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.339918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 975/1938] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:34 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:34.358133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbed295-cf32-4c67-90ff-8f703eca4449 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.615865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.617193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.617689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.619197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.620432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.626309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.690333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 964/1939] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:34 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:34.693610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.714746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f333cb5-01e1-4e9d-9164-569bb638c887 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.725010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.726294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.726808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.727311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.729922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.732269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.779013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.794465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 976/1940] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:34.808799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877899b6-66f5-4d8b-900a-31609d1fca80 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.816935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.818827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.819615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.820163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.821744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.826809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75dafd-ee87-4c6d-90e2-4a2eef39a662 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.848683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 965/1941] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:34.855145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:34.889808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2fa3-760c-467f-9e68-f89bf966d70a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:34.898046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:34.899154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:34.899650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:34.900215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] PATH_INFO: `/v3/projects/fb2d03f3fe724e3ab137c09ae7f84e09/users/0601db8f08144f4db0a571b569fd2211/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:34.937614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2d03f3fe724e3ab137c09ae7f84e09, user_id=0601db8f08144f4db0a571b569fd2211, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:34.945299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:34.987758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 977/1942] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:34 2022] PUT /identity/v3/projects/fb2d03f3fe724e3ab137c09ae7f84e09/users/0601db8f08144f4db0a571b569fd2211/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:35.006015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.007021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.008149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.078036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] MFA Rules not processed for user `0601db8f08144f4db0a571b569fd2211`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:35.086841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.089966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:35.104049 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:35.154240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:35.235832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6c9a-9fea-4677-bf3f-6758d2827b73 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.253875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.253875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.253875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.254645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] PATH_INFO: `/v3/projects/7387d786adfa4c8d89496fed25bff427` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.257924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7387d786adfa4c8d89496fed25bff427)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.259994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 966/1943] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:35.261661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.266734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.283724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbd07d-4f03-4c38-9274-4be403e81a48 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.290660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.292064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.292376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.292792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.294568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.298464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.353116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 967/1944] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:35.355039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.362773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7387d786adfa4c8d89496fed25bff427', 'request_id': 'req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:35.385290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7387d786adfa4c8d89496fed25bff427', 'request_id': 'req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:35.397603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7387d786adfa4c8d89496fed25bff427', 'request_id': 'req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:35.408705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:35.420642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] The token cache is being invalidate because project 7387d786adfa4c8d89496fed25bff427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:35.421983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:35.423244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-601ffe3e-21c6-48f8-a41f-6cba1a83cb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:35.431873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 978/1945] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:35 2022] DELETE /identity/v3/projects/7387d786adfa4c8d89496fed25bff427 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:35.435411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d288-73d6-46b2-9f27-42e90e11cd71 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.436092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d288-73d6-46b2-9f27-42e90e11cd71 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.436567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d288-73d6-46b2-9f27-42e90e11cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.494402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f2a8d288-73d6-46b2-9f27-42e90e11cd71 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:35.498642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f2a8d288-73d6-46b2-9f27-42e90e11cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:35.528841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 979/1946] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:35.530513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.530866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.531237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.584545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737f266-c9fe-43a6-878a-cc81ea0acfc8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.601096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:35.605516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:35.614583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.624880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.624880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.624880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.624880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.631731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.660659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 980/1947] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:35.662660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.689824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d62ba-af8d-431c-9fb9-2456ab850a72 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.697239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 968/1948] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/users => generated 289 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:35.703602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.707211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:35.720495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.721992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.722492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.722981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.724177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:35.724748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.727867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.751909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 981/1949] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:35.758479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.769249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7bae-6210-4c41-b1be-c4f8f8908740 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.779587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62a62-6a29-43c2-a33e-d92505991d28 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.789744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.792215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.792420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.795073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17717d38-d386-4789-b081-656818778e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:35.795753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.797227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717d38-d386-4789-b081-656818778e5b admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:35.798479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.799078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717d38-d386-4789-b081-656818778e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:35.799361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17717d38-d386-4789-b081-656818778e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:35.805696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17717d38-d386-4789-b081-656818778e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:35.808769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.814149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17717d38-d386-4789-b081-656818778e5b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:35.873011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 969/1950] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:35.875753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:35.922296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 982/1951] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:35.927591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51a01-c21f-4b8c-a8cb-0dc5a51415e0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:35.930347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17717d38-d386-4789-b081-656818778e5b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.031478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.032124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.032417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.032700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.033395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.035081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.053950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 970/1952] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:36.055195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.068443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cefbd1-2035-4510-9a66-691a698e9bf7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.075867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.076566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.076850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.077128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] PATH_INFO: `/v3/projects/84b024d6db9640829f7cb3149e1039d1/users/e453cd7936f24a52ad0cb8eab164efc5/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.102500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b024d6db9640829f7cb3149e1039d1, user_id=e453cd7936f24a52ad0cb8eab164efc5, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.106207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5ff34-524e-42d6-b6e1-bacd9e791c4a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.126802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 971/1953] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:36 2022] PUT /identity/v3/projects/84b024d6db9640829f7cb3149e1039d1/users/e453cd7936f24a52ad0cb8eab164efc5/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:36.144801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.145301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.145970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.150070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17717d38-d386-4789-b081-656818778e5b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.187258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] MFA Rules not processed for user `e453cd7936f24a52ad0cb8eab164efc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:36.189236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:36.199526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:36.318515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:36.338802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 972/1954] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:36.341548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.384949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.386093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.386605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.391689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.395283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.399078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.479937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 983/1955] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:35 2022] POST /identity/v3/users => generated 281 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:36.485054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.534345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3016-1645-41e5-8d39-78c4b04ed2ae admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.557862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.558968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.559352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.559630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.560739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.562833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.630658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35cf87-af45-4ec0-9161-833c60398c20 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.635367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 984/1956] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:36.642821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.669487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.672837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.673514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.674262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.679424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.683135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.702259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a1bf5-2c3b-4c0f-9214-ea80325b86a5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.724574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.728163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.728994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.731728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.736166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.749709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.782988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 985/1957] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:36.786671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.804900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 973/1958] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:36 2022] POST /identity/v3/projects => generated 377 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:36.807004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.818614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1e9e-8c2a-4c72-b87e-f8fbc8989f29 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.926492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176311c-a2f0-480e-9e74-31023ea162ef admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.933303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.933990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.934853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.935098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.935753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:36.937708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:36.963556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 974/1959] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:36 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:36.967741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:36.982030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.983751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.983915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae183cb-a568-46e9-bf9c-31a5c227b453 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:36.984716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.985750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] PATH_INFO: `/v3/projects/9b6bb6a6022143afa92fb232f8863a6b/users/784c000e02d648e79bec975d04274786/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.993697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:36.995808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:36.995808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:36.995808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:36.997465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:37.000579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:37.026165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6bb6a6022143afa92fb232f8863a6b, user_id=784c000e02d648e79bec975d04274786, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:37.030073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 975/1960] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:37.032672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f157dba-97ea-4110-809a-8d879ed3b43e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:37.039962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:37.068733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58debd5f-1443-43cb-b98e-ed2f7dc2c512 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:37.079106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 986/1961] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:36 2022] PUT /identity/v3/projects/9b6bb6a6022143afa92fb232f8863a6b/users/784c000e02d648e79bec975d04274786/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:37.093970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.094692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.095104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:37.170419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:37.172281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.173070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.174035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] PATH_INFO: `/v3/projects/a467d195f128422984bf46bfe405627d/users/cede2c476552431099f9d93bcc5b6e26/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:37.181787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:37.185365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] MFA Rules not processed for user `784c000e02d648e79bec975d04274786`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:37.204408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:37.221438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467d195f128422984bf46bfe405627d, user_id=cede2c476552431099f9d93bcc5b6e26, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:37.233162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:37.272960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 976/1962] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:37 2022] PUT /identity/v3/projects/a467d195f128422984bf46bfe405627d/users/cede2c476552431099f9d93bcc5b6e26/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:37.274883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:37.380609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:37.413154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 987/1963] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:37.456768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cba6-d282-41e9-8943-762e38559203 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:37.467170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:37.469227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:37.471762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:37.473647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.474371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.475081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:37.476665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:37.481074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:37.507837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 977/1964] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:37.515166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:37.565476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525467-f673-499e-bb1b-10d174b6d6d4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:37.603732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:37.604983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.605498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.606081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] PATH_INFO: `/v3/projects/a467d195f128422984bf46bfe405627d/users/cede2c476552431099f9d93bcc5b6e26/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:37.614099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467d195f128422984bf46bfe405627d, user_id=cede2c476552431099f9d93bcc5b6e26, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:37.626602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659ac7b-c454-43db-996b-aaddbd0d4a94 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:37.669654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 978/1965] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:37 2022] PUT /identity/v3/projects/a467d195f128422984bf46bfe405627d/users/cede2c476552431099f9d93bcc5b6e26/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:37.690835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.691452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.692228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:37.740987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e529d-3487-4cb2-b918-7dd5d079cc37 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:37.750380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] MFA Rules not processed for user `cede2c476552431099f9d93bcc5b6e26`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:37.752892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:37.951195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 979/1966] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:37.995088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:37.996130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:37.997205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:37.997956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:38.068119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:38.073113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:38.103111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049da6-bc95-443a-89b5-c2ecb7eb4436 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:38.110426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:38.114410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:38.114410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:38.114410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:38.129298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:38.157242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:38.159044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:38.170854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 988/1967] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:38.198870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:38.325955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:38.351327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:38.354274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba81bd-cde9-406b-b0bf-0f160e0a9037 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:38.389448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 980/1968] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:38.395249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713834f5-58a9-43aa-b149-954787db4ff4 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:38.404813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:38.406275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:38.406965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:38.407671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] PATH_INFO: `/v3/users/784c000e02d648e79bec975d04274786` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:38.429355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=784c000e02d648e79bec975d04274786)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:38.440368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:38.460046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:38.619475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784c000e02d648e79bec975d04274786'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:38.620822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784c000e02d648e79bec975d04274786'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:38.646118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784c000e02d648e79bec975d04274786'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:38.646974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784c000e02d648e79bec975d04274786'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:38.658799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784c000e02d648e79bec975d04274786'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:38.680658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 989/1969] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:38 2022] DELETE /identity/v3/users/784c000e02d648e79bec975d04274786 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:38.687815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:38.688261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:38.688691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:38.774560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:38.786301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:38.971014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 981/1970] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:38.986336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:38.987862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:39.086880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150b943-cfd0-4bca-8dd0-c7f737c74632 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:39.104951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:39.107226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:39.107394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:39.107684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:39.125277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:39.126977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70bcd8-f115-4e82-b2e9-55ab1ee645b0 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:39.156155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 990/1971] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:39.727378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:39.728982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:39.746310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42635c02-c10f-412c-86da-c2aeee58e290 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:39.757670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:39.758621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:39.760470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:39.761021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] PATH_INFO: `/v3/projects/9b6bb6a6022143afa92fb232f8863a6b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:39.763819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6bb6a6022143afa92fb232f8863a6b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:39.769419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:39.914993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6bb6a6022143afa92fb232f8863a6b', 'request_id': 'req-630665bc-869c-475f-910b-f2251fbe38f5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:39.931162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6bb6a6022143afa92fb232f8863a6b', 'request_id': 'req-630665bc-869c-475f-910b-f2251fbe38f5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:39.946558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6bb6a6022143afa92fb232f8863a6b', 'request_id': 'req-630665bc-869c-475f-910b-f2251fbe38f5'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:39.976179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] The token cache is being invalidate because project 9b6bb6a6022143afa92fb232f8863a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:39.977185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:39.979213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:39.987610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 982/1972] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:39 2022] DELETE /identity/v3/projects/9b6bb6a6022143afa92fb232f8863a6b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:39.988849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88817e-83c7-46ec-b9f1-11805d0844b0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:39.989685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88817e-83c7-46ec-b9f1-11805d0844b0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:39.989685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88817e-83c7-46ec-b9f1-11805d0844b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.027319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0a88817e-83c7-46ec-b9f1-11805d0844b0 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:40.028771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0a88817e-83c7-46ec-b9f1-11805d0844b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.065674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.069171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.146975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 991/1973] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:40.161804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.162237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.162413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.222395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:40.225089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.276677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630665bc-869c-475f-910b-f2251fbe38f5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:40.283378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:40.283994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.286132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.286410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] PATH_INFO: `/v3/users/aca4622f517e427c9b3679b3465eecd2` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.289590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca4622f517e427c9b3679b3465eecd2)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:40.295186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:40.296609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 992/1974] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:40.301094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.316909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357116-7457-42ee-a374-41e0586a9f5e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:40.325811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:40.326911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.329294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.329858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.330712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:40.331175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:40.333681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:40.346225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:40.404219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 993/1975] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:53:40.415211 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.428789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca4622f517e427c9b3679b3465eecd2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:40.430123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca4622f517e427c9b3679b3465eecd2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:40.431230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca4622f517e427c9b3679b3465eecd2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:40.453052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0add-0584-4326-8ba8-d4838671e0ac admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:40.467083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:40.467721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.468004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.474235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.489845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:40.494019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:40.498792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca4622f517e427c9b3679b3465eecd2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:40.509760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:40.511255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-b309503d-1bb5-413c-a9c7-e154a9d3d7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca4622f517e427c9b3679b3465eecd2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:40.537471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 983/1976] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:40 2022] DELETE /identity/v3/users/aca4622f517e427c9b3679b3465eecd2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:40.541982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.542584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.543057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.568666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 994/1977] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:40 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:40.573808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.579124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.617223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:40.620855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.854426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd50a-28d9-48d8-a846-582c0252873a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:40.865111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:40.867215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.867792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.868484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.870561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:40.875134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:40.893635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 984/1978] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:40.911347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.914632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:40.936800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 995/1979] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:40 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:40.940782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:40.969644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec4e-01e4-4c06-aaf5-1cb82ef2da77 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:40.978362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:40.979819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:40.980386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:40.981480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:40.983409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:40.985847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.011849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 996/1980] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:41.014490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.017264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.122331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68722fd-710b-4df2-8f87-889e9a6ad47b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.133234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.134081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.134378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.134730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.156169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.158357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.172750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 985/1981] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:41.188003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.194020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1e6c5-64fc-41c6-8f1b-d5b7744bca60 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.210641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.211305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.211582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.211898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.213976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.214786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b092-659c-4cf1-a6e4-9140e718ec69 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.235346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.236211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.236676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.237751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.242244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.243982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.266223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 986/1982] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:41.273798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.295684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05c7-9613-4f6e-afba-8d0d44420b6c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.310647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.312858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.313311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.313635 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] PATH_INFO: `/v3/projects/c7af6220a0414a879eda39fd28b3c94f/users/9631ed2a0ad34ee2b1027247ab6eb411/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.348396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7af6220a0414a879eda39fd28b3c94f, user_id=9631ed2a0ad34ee2b1027247ab6eb411, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.353142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5b8b-5b5c-4396-a063-375bef8a2108 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.378069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.379471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.383958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 987/1983] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:41 2022] PUT /identity/v3/projects/c7af6220a0414a879eda39fd28b3c94f/users/9631ed2a0ad34ee2b1027247ab6eb411/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:41.397609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 997/1984] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:41.407659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.408243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.408704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.423945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:41.485540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] MFA Rules not processed for user `9631ed2a0ad34ee2b1027247ab6eb411`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:41.488246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.764165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 988/1985] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:41.766750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.804168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e172fd-9429-4ecd-91dd-4109ca34e374 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.869490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:42.008478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.009747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.010415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.011132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.012702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.016516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.098771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 998/1986] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:41 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:42.104787 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.133228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.135986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:42.140179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1335b-15e3-445b-9332-fe85410b8ae6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:42.268126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8c253-ccb3-4698-8c08-4507e0a22ba7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:42.274420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.275144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.275440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.275724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] PATH_INFO: `/v3/projects/469ee86e4e554bc28025b1c1a92e0885` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.280103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469ee86e4e554bc28025b1c1a92e0885)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.284026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.286445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.287855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.288721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.290120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.293020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.301744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.396616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469ee86e4e554bc28025b1c1a92e0885', 'request_id': 'req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.409592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 989/1987] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:42 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:42.412259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.416222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469ee86e4e554bc28025b1c1a92e0885', 'request_id': 'req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.435195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469ee86e4e554bc28025b1c1a92e0885', 'request_id': 'req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.451304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f8626-c504-41c1-b480-f14552c0edb0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:42.463815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] The token cache is being invalidate because project 469ee86e4e554bc28025b1c1a92e0885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:42.464752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.466303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.469831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 999/1988] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:42 2022] DELETE /identity/v3/projects/469ee86e4e554bc28025b1c1a92e0885 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:42.477354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.481391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:42.602068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:42.626523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.629414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.629938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.631640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.632886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.635811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.689457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f80a-3ec0-4ac8-8ccb-d042f48b5bd0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:42.690688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 990/1989] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:42.694055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.696761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:42.701064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.702267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.702849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.703431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] PATH_INFO: `/v3/users/72e614d57d6a4a6a8ea43e2ff31100d7` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.705585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e614d57d6a4a6a8ea43e2ff31100d7)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.710933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.733322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d10a-0ccd-475c-99c8-b6f05108ddc4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:42.744769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:42.746093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:42.747168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:42.748920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] PATH_INFO: `/v3/projects/c45047fd820e4d8f976b4204ec37e7e4/users/d5221b10939941619c562f07a1af8b30/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:42.787245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45047fd820e4d8f976b4204ec37e7e4, user_id=d5221b10939941619c562f07a1af8b30, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:42.793740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:42.800814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:42.809309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e614d57d6a4a6a8ea43e2ff31100d7'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.814851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e614d57d6a4a6a8ea43e2ff31100d7'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.832662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e614d57d6a4a6a8ea43e2ff31100d7'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.833724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e614d57d6a4a6a8ea43e2ff31100d7'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.844569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e614d57d6a4a6a8ea43e2ff31100d7'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:42.872214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 991/1990] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:42 2022] PUT /identity/v3/projects/c45047fd820e4d8f976b4204ec37e7e4/users/d5221b10939941619c562f07a1af8b30/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:42.874189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1000/1991] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:42 2022] DELETE /identity/v3/users/72e614d57d6a4a6a8ea43e2ff31100d7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:42.883170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.888492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:42.988962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:42.991104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:43.093889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4319-7a8d-4f2c-b62f-002ee23e8ba7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.158408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e3d0-9037-4b0e-a4bf-f41697635397 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.170122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:43.171060 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.172526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.172993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.187598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:43.271651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:43.271651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.272674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.272674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.274034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:43.277652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:43.300698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 992/1992] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:43.305254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:43.329446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c8ca2-f53e-4fd4-b38b-d1be58183269 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.336342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:43.337505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.339126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.339363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] PATH_INFO: `/v3/projects/c45047fd820e4d8f976b4204ec37e7e4/users/d5221b10939941619c562f07a1af8b30/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.344192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45047fd820e4d8f976b4204ec37e7e4, user_id=d5221b10939941619c562f07a1af8b30, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:43.352559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8cf43-7e1b-429e-bc9e-7ae58944c743 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:43.354013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:43.356116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:43.374255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 993/1993] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:43 2022] PUT /identity/v3/projects/c45047fd820e4d8f976b4204ec37e7e4/users/d5221b10939941619c562f07a1af8b30/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:43.387585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.388597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.389276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.390606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1001/1994] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:43.483295 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] MFA Rules not processed for user `d5221b10939941619c562f07a1af8b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:43.485447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:43.665980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:43.669405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:43.718875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 994/1995] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:43.727395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:43.741378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:43.780546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27b526-e388-4c65-8616-f211e72a765e service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.781037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:43.972467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b307d-a2ff-4776-b02c-4597e0058346 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.990040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:43.991047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.991511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.992199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.998408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:44.038310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.039582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.040093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.040598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] PATH_INFO: `/v3/projects/f5de82dcbe404853976eb1b066d9743c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.042972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5de82dcbe404853976eb1b066d9743c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.047628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.131889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.133463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5de82dcbe404853976eb1b066d9743c', 'request_id': 'req-cee8a763-9f7d-49ac-8b5a-e633962d69d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:44.134065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59228b6-fa20-422c-9279-596cabc8847f service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.148112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5de82dcbe404853976eb1b066d9743c', 'request_id': 'req-cee8a763-9f7d-49ac-8b5a-e633962d69d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:44.154414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 995/1996] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:44.157450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5de82dcbe404853976eb1b066d9743c', 'request_id': 'req-cee8a763-9f7d-49ac-8b5a-e633962d69d8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:44.170891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] The token cache is being invalidate because project f5de82dcbe404853976eb1b066d9743c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:44.171625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:44.172476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cee8a763-9f7d-49ac-8b5a-e633962d69d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:44.178781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1002/1997] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:43 2022] DELETE /identity/v3/projects/f5de82dcbe404853976eb1b066d9743c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:44.181054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.181483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.181929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.223688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:44.226886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:44.354752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 996/1998] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:44.363273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.364111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.365441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.407530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:44.409682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:44.424579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1003/1999] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:44.429353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:44.446599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6cd99-8607-47d4-8ca6-158ce001c0ec None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:44.454744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.455752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.456251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.456925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.458142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:44.458748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.461854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.485241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 997/2000] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:44.491163 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:44.505972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2ac7d-d9c2-4a65-83d0-4f8dac5da066 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:44.515294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.516628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.516984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.517312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.518379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.522220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.593876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1004/2001] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:44 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:44.606609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:44.634040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d7b-9440-422a-aef2-4a35c158fdd1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:44.755056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:44.776593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.778782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.779377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.779962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.781229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.785032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.844629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 998/2002] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:44 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:44.845680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:44.867293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a4b4-1cee-47ed-830c-980111070cc5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:44.880483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.880483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.880483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.881145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.882446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.887727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:44.918964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1005/2003] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:44.921994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:44.943135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9b05-1b2f-451e-9b58-d094654337dd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:44.968665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:44.971453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:44.975320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:44.976583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:44.978096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:44.983579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401fd93-82ef-451d-a63c-29ce0afdbc36 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:45.023509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 999/2004] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:45.024685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:45.063120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d712-4afb-4bec-a807-82ed16a5b162 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:45.082093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:45.085961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:45.086879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:45.087640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] PATH_INFO: `/v3/projects/6f861f773f44455b839ba0bda3b726ac/users/dcd28af2987548c3a740c7475a37a611/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:45.149649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f861f773f44455b839ba0bda3b726ac, user_id=dcd28af2987548c3a740c7475a37a611, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:45.152914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:45.201043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1006/2005] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:45 2022] PUT /identity/v3/projects/6f861f773f44455b839ba0bda3b726ac/users/dcd28af2987548c3a740c7475a37a611/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:45.206172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:45.206695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:45.207257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:45.310798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] MFA Rules not processed for user `dcd28af2987548c3a740c7475a37a611`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:45.315526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:45.466769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1000/2006] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:45.471533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:45.533316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:45.605445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0b26-c3ac-4d6c-9711-a3dcb9545017 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:45.614174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:45.615341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:45.615923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:45.616482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:45.618261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:45.622424 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:45.673629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1007/2007] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:45 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:45.678903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:45.698364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649425-966c-41b8-92df-9fb011c4aea1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:45.828009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:45.829060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:45.829587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:45.830114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:45.831090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:45.834177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:45.913823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1001/2008] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:45 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:45.917202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:45.932314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971b146-f1d8-43aa-92ee-d18c0d725a4d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:45.944107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:45.945697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:45.946416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:45.947505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:45.948733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:45.950581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:45.963563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1008/2009] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:45.969122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.002760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04e63-73f5-4873-9d0f-80451a572be2 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.014006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.016098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.016999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.018037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.021928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.025560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57870f65-f089-4acf-81ca-882c945eaf99 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.049103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1002/2010] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:46.054326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.064984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940514b3-46c9-4fe5-9b39-d75b68493bc9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.075071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.075933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.077713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.078175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] PATH_INFO: `/v3/projects/2a62ddc726034849ae8b3751fb115591/users/dcba780d4f1742cb88545c413cbff820/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.106262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a62ddc726034849ae8b3751fb115591, user_id=dcba780d4f1742cb88545c413cbff820, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.109668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.132533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1009/2011] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:46 2022] PUT /identity/v3/projects/2a62ddc726034849ae8b3751fb115591/users/dcba780d4f1742cb88545c413cbff820/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:46.155740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.156252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.157171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.220115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] MFA Rules not processed for user `dcba780d4f1742cb88545c413cbff820`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:46.222149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:46.275915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:46.354362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1003/2012] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:46.359342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.455194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2a84-b444-4582-a7ed-40053f2695a6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.463252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.464186 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.464639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.465122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.466171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.469675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.527548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1010/2013] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:46 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:46.534582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.564494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981f17-3e05-4ffd-97b0-ebbbcc70cb41 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.666453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.667834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.669148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.669680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.670715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.673045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.735927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1004/2014] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:46 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:46.738486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.755939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5373-baa6-4902-95ec-de5f77cd413e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.761301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.761999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.762303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.762596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.763219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.764841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.788985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1011/2015] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:46.800144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.824808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bdae0-c206-404f-baba-45f74edacec0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:46.837834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:46.838624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:46.839333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:46.841833 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] PATH_INFO: `/v3/projects/6b45b97a461a4796a78ede0884242eb3/users/9e8ecf8045c44c81b85a4f49f0e2907a/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:46.888545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b45b97a461a4796a78ede0884242eb3, user_id=9e8ecf8045c44c81b85a4f49f0e2907a, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:46.895852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:46.937421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1005/2016] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:46 2022] PUT /identity/v3/projects/6b45b97a461a4796a78ede0884242eb3/users/9e8ecf8045c44c81b85a4f49f0e2907a/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:46.938739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:46.952919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbbefb-af74-4742-af6b-5d991c09b39d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:47.051074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:47.068714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:47.069642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.070158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.070681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.071993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:47.075891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e2540-0b3b-4a53-9c69-8a818f1f5ea2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:47.097484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1012/2017] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:47.102348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:47.122823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5cf41-87f6-490f-8b9a-34f9bfa9e281 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:47.139675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:47.140844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.141334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.143350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] PATH_INFO: `/v3/projects/6b45b97a461a4796a78ede0884242eb3/users/9e8ecf8045c44c81b85a4f49f0e2907a/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.149490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b45b97a461a4796a78ede0884242eb3, user_id=9e8ecf8045c44c81b85a4f49f0e2907a, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:47.152247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:47.169724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1006/2018] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:47 2022] PUT /identity/v3/projects/6b45b97a461a4796a78ede0884242eb3/users/9e8ecf8045c44c81b85a4f49f0e2907a/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:47.182877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.183387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.184436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.238573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:47.242263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:47.271993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] MFA Rules not processed for user `9e8ecf8045c44c81b85a4f49f0e2907a`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:47.274930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:47.404904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e27f-94ab-4b50-bf05-ca003bc74169 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:47.411371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:47.412637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.413056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.413435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] PATH_INFO: `/v3/users/9631ed2a0ad34ee2b1027247ab6eb411` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.415827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9631ed2a0ad34ee2b1027247ab6eb411)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:47.419064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:47.463552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1013/2019] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:47.468125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:47.482893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:47.484547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:47.538697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9631ed2a0ad34ee2b1027247ab6eb411'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:47.540226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9631ed2a0ad34ee2b1027247ab6eb411'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:47.541555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9631ed2a0ad34ee2b1027247ab6eb411'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:47.585931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324dbbf-c5c8-4925-b987-6b4f9bef6da1 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:47.592275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9631ed2a0ad34ee2b1027247ab6eb411'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:47.593731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:47.594820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.595380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.595918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.598695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:47.615702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8553c6b3-f235-45ad-b2a7-e20eb3eed3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9631ed2a0ad34ee2b1027247ab6eb411'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:47.626742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:47.629160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:47.644803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1007/2020] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:47 2022] DELETE /identity/v3/users/9631ed2a0ad34ee2b1027247ab6eb411 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:47.647476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1014/2021] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:47.651911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:47.652352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:47.653318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:47.685827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:47.687930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:47.856095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1008/2022] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:47.868951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:47.872640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:48.077596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4e3d-62f8-4231-ada6-24ff9bb759eb service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:48.201842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:48.265698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:48.267204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:48.268972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:48.270172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:48.318721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:48.321373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:48.358090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1015/2023] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:48.755902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:48.756786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:48.759264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:48.759966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:48.781818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1677c-0baf-4e50-9a10-2af1dcc82612 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:48.798970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:48.801014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:48.801824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:48.802755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] PATH_INFO: `/v3/users/0601db8f08144f4db0a571b569fd2211` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:48.805433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0601db8f08144f4db0a571b569fd2211)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:48.810237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:48.827441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc30d56-40a2-43ee-a78e-33dfb2545101 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:48.847935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:48.850054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:48.850054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:48.850461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] PATH_INFO: `/v3/users/92ba8e92c99641cfb418266f5374f0e0` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:48.854994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ba8e92c99641cfb418266f5374f0e0)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:48.863213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:48.974107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0601db8f08144f4db0a571b569fd2211'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:48.976791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0601db8f08144f4db0a571b569fd2211'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:48.978754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0601db8f08144f4db0a571b569fd2211'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.008925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ba8e92c99641cfb418266f5374f0e0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.010333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ba8e92c99641cfb418266f5374f0e0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.032372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0601db8f08144f4db0a571b569fd2211'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.043792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ba8e92c99641cfb418266f5374f0e0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.045656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ba8e92c99641cfb418266f5374f0e0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.054610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0601db8f08144f4db0a571b569fd2211'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.063273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4f0c40c9-5e83-4701-9189-836f761888fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ba8e92c99641cfb418266f5374f0e0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.087651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1009/2024] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:48 2022] DELETE /identity/v3/users/0601db8f08144f4db0a571b569fd2211 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:49.092867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:49.095982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.097000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1016/2025] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:48 2022] DELETE /identity/v3/users/92ba8e92c99641cfb418266f5374f0e0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:49.099779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.100777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.101146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.131227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:49.146864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:49.148931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.231312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bda9e-898f-41d9-bfb1-e923a0913f70 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:49.263724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1017/2026] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:49.265216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:49.270929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.339320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:49.340511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.341037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.341558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] PATH_INFO: `/v3/projects/c7af6220a0414a879eda39fd28b3c94f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.343653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7af6220a0414a879eda39fd28b3c94f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:49.347280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:49.354990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9c57-10ba-4b84-90d3-ca71d794b09a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:49.361864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:49.362778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.363196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.363504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.366546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.373820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:49.428975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7af6220a0414a879eda39fd28b3c94f', 'request_id': 'req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.443575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7af6220a0414a879eda39fd28b3c94f', 'request_id': 'req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.453602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7af6220a0414a879eda39fd28b3c94f', 'request_id': 'req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.467881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:49.471128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:49.474151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] The token cache is being invalidate because project c7af6220a0414a879eda39fd28b3c94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:49.474582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.475696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.477620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1010/2027] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:49 2022] DELETE /identity/v3/projects/c7af6220a0414a879eda39fd28b3c94f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:49.478687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:49.483153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.487725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1018/2028] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:49.489175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:49.491063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.514434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1151a-cf49-4c26-a20b-36b20933b291 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:49.560900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:49.570292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d5c-412a-4389-bf6f-4eea41b0c5b1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:49.581311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:49.582680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.583108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.583512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.586379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.657079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:49.657985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.658279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.658564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] PATH_INFO: `/v3/projects/2b388a89bcf642c2b5ef16ffc34b53f7` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.660302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b388a89bcf642c2b5ef16ffc34b53f7)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:49.662287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:49.731105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:49.734333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:49.747102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b388a89bcf642c2b5ef16ffc34b53f7', 'request_id': 'req-fe07ac72-dabe-4415-9283-f7a57aaef8f0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.753547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1011/2029] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:49.755371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:49.758565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.781703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb399eb-796a-4d60-bd79-2bc8722f4fb4 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:49.782019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b388a89bcf642c2b5ef16ffc34b53f7', 'request_id': 'req-fe07ac72-dabe-4415-9283-f7a57aaef8f0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.795322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b388a89bcf642c2b5ef16ffc34b53f7', 'request_id': 'req-fe07ac72-dabe-4415-9283-f7a57aaef8f0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.823331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] The token cache is being invalidate because project 2b388a89bcf642c2b5ef16ffc34b53f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:49.823690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.825107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fe07ac72-dabe-4415-9283-f7a57aaef8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:49.830461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1019/2030] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:49 2022] DELETE /identity/v3/projects/2b388a89bcf642c2b5ef16ffc34b53f7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:49.836630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728914-2037-4ce1-b5ed-f0dd22828183 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.837239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728914-2037-4ce1-b5ed-f0dd22828183 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.837856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728914-2037-4ce1-b5ed-f0dd22828183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.888703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-99728914-2037-4ce1-b5ed-f0dd22828183 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:49.891047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-99728914-2037-4ce1-b5ed-f0dd22828183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:49.934158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:49.934934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:49.935119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:49.935335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] PATH_INFO: `/v3/users/d5221b10939941619c562f07a1af8b30` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:49.936731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5221b10939941619c562f07a1af8b30)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:49.939863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:49.961484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:50.076968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5221b10939941619c562f07a1af8b30'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.078356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5221b10939941619c562f07a1af8b30'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.079462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5221b10939941619c562f07a1af8b30'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.088543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1020/2031] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:50.123432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.123935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.124420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.145655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5221b10939941619c562f07a1af8b30'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.162058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5221b10939941619c562f07a1af8b30'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.200523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:50.202639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:50.225255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1012/2032] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:49 2022] DELETE /identity/v3/users/d5221b10939941619c562f07a1af8b30 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:50.233069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1021/2033] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:50.239877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.286513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:50.373803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.376901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:50.395980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed8f1-96f6-43f2-ba54-8c18ccc2b791 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.397644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ace38-2c2a-4fa0-a794-777486bbb472 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.412144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.416620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.420663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.421204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.424184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:50.424494 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.425485 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.425750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.426293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.426771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] PATH_INFO: `/v3/projects/fb2d03f3fe724e3ab137c09ae7f84e09` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.429649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2d03f3fe724e3ab137c09ae7f84e09)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.434070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.434822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.487186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1013/2034] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:50.490250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.518769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce26f1-6caa-46ce-9009-f9a99a25c69f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.548079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2d03f3fe724e3ab137c09ae7f84e09', 'request_id': 'req-4abddac9-e5a5-4e83-871f-b52f2e9802ac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.574688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2d03f3fe724e3ab137c09ae7f84e09', 'request_id': 'req-4abddac9-e5a5-4e83-871f-b52f2e9802ac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.592398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2d03f3fe724e3ab137c09ae7f84e09', 'request_id': 'req-4abddac9-e5a5-4e83-871f-b52f2e9802ac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.611924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] The token cache is being invalidate because project fb2d03f3fe724e3ab137c09ae7f84e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:50.612534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.613604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.620012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1022/2035] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:50 2022] DELETE /identity/v3/projects/fb2d03f3fe724e3ab137c09ae7f84e09 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:50.621439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.624002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:50.645026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.646672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.647006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.647458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.648670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.651845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.713272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1014/2036] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:50 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:50.720232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.723276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:50.731874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abddac9-e5a5-4e83-871f-b52f2e9802ac admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.864502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618c8ab-e176-468d-a6f3-d11fc13d99af admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.870742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.871975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.872309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.872592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.873206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.874828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.875572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.876155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.876687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.877259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] PATH_INFO: `/v3/users/e453cd7936f24a52ad0cb8eab164efc5` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.880084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e453cd7936f24a52ad0cb8eab164efc5)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.888947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.895232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:50.915658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1015/2037] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:50 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:50.919284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.943370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19150f-558f-4b3f-a40b-bae7ab98b56e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:50.952853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:50.954077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:50.954760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:50.955101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:50.956498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:50.959871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:50.978637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1016/2038] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:50.984625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:50.996658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e453cd7936f24a52ad0cb8eab164efc5'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:50.997954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e453cd7936f24a52ad0cb8eab164efc5'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.004659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee34a3-7a48-4cb8-b9eb-f06be7b98cc7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.014576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.015940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.016135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.016598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.017912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.020991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:51.026081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e453cd7936f24a52ad0cb8eab164efc5'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.027905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e453cd7936f24a52ad0cb8eab164efc5'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.044292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e453cd7936f24a52ad0cb8eab164efc5'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.048886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1017/2039] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:51.055973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:51.059774 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.083823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:51.090974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1023/2040] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:50 2022] DELETE /identity/v3/users/e453cd7936f24a52ad0cb8eab164efc5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:51.098975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeff76-c1ce-4cca-a955-baf614cd6b58 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.137473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:51.139824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.281904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.283242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.283747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.284242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] PATH_INFO: `/v3/projects/d5f6cf67f3c54025ba5abf87ec199a94/users/1b7b74f3b6d24b42b3914179c37af5f1/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.331049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f6cf67f3c54025ba5abf87ec199a94, user_id=1b7b74f3b6d24b42b3914179c37af5f1, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.331935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6600-c0cb-4f27-8744-fbedd91a08a0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.336790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ffc38-2912-4ba9-ab8d-d4d0eab48042 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:51.349309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.350818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.351663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.352120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] PATH_INFO: `/v3/projects/c45047fd820e4d8f976b4204ec37e7e4` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.354795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45047fd820e4d8f976b4204ec37e7e4)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.359745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:51.375779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1018/2041] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:51 2022] PUT /identity/v3/projects/d5f6cf67f3c54025ba5abf87ec199a94/users/1b7b74f3b6d24b42b3914179c37af5f1/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:51.387283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.388247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.389093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.469298 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] MFA Rules not processed for user `1b7b74f3b6d24b42b3914179c37af5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:51.470615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.473909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45047fd820e4d8f976b4204ec37e7e4', 'request_id': 'req-cab94c2b-a579-4b43-a915-8267b7da2587'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.490168 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45047fd820e4d8f976b4204ec37e7e4', 'request_id': 'req-cab94c2b-a579-4b43-a915-8267b7da2587'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.517492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45047fd820e4d8f976b4204ec37e7e4', 'request_id': 'req-cab94c2b-a579-4b43-a915-8267b7da2587'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.548068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] The token cache is being invalidate because project c45047fd820e4d8f976b4204ec37e7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:51.548531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.549633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-cab94c2b-a579-4b43-a915-8267b7da2587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:51.556058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1024/2042] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:51 2022] DELETE /identity/v3/projects/c45047fd820e4d8f976b4204ec37e7e4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:51.569391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b962-2e96-4c56-b09b-430ce8ed6b47 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.570010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b962-2e96-4c56-b09b-430ce8ed6b47 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.570480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b962-2e96-4c56-b09b-430ce8ed6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.626676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d399b962-2e96-4c56-b09b-430ce8ed6b47 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:51.629539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d399b962-2e96-4c56-b09b-430ce8ed6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.645843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1019/2043] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:51.649814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:51.665219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:51.670953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.781333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1025/2044] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:51.791526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.791861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.792462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.831584 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:51.833820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.850359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1026/2045] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:51.852191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:51.856196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:51.857899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03bd7-5e64-4e17-84a6-816b823bf1ec None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.866159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.867165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.868134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.868134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.881087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112801e-7ee0-4e20-94c9-4268b44279ca None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.884664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.892246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:51.899294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.899294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.899782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.900141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] PATH_INFO: `/v3/projects/84b024d6db9640829f7cb3149e1039d1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.901651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b024d6db9640829f7cb3149e1039d1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.904472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:51.915261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1020/2046] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:51.918532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:51.928591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:51.958597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6149-19e8-44a3-9c99-45e8a5b77f97 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:51.968061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:51.968970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:51.969432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:51.969912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:51.971032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:51.971639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:51.973786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.002510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1021/2047] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:52.018192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.022855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b024d6db9640829f7cb3149e1039d1', 'request_id': 'req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.032139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa5e2-8abb-4c26-b32d-ea28500b9dea admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.050381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b024d6db9640829f7cb3149e1039d1', 'request_id': 'req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.064170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b024d6db9640829f7cb3149e1039d1', 'request_id': 'req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.082376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] The token cache is being invalidate because project 84b024d6db9640829f7cb3149e1039d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:52.082699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.083539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.085337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1027/2048] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:51 2022] DELETE /identity/v3/projects/84b024d6db9640829f7cb3149e1039d1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:52.089442 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.095304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:52.142961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.143944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.144428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.144838 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.145622 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.148568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.188391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a25dd-ef5e-40a4-a88e-49e5eb6d5006 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.194776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1022/2049] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:52.195515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.197553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:52.233921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:52.282382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.283426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.284263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.284808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] PATH_INFO: `/v3/users/cede2c476552431099f9d93bcc5b6e26` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.286774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cede2c476552431099f9d93bcc5b6e26)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.290017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.312799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13ddc-36eb-4cfa-9a70-13fbe2d4dab4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.320414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.321049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.321378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.321656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.323093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.325912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.359095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1023/2050] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:52 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:52.362045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.376386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c358bda-6c47-4d05-9701-7d246bdb00d6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.385396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.387113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.389331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.389975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.390668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.395265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.404327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cede2c476552431099f9d93bcc5b6e26'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.405094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cede2c476552431099f9d93bcc5b6e26'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.432395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cede2c476552431099f9d93bcc5b6e26'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.433461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cede2c476552431099f9d93bcc5b6e26'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.445659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cede2c476552431099f9d93bcc5b6e26'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:52.452450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1024/2051] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:53:52.457055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.464242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:52.477834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1028/2052] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:52 2022] DELETE /identity/v3/users/cede2c476552431099f9d93bcc5b6e26 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:52.505132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d184-d46a-4c69-934c-1eaa8e2aa778 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.578473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:52.591932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.593388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.593627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.595504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.599079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.602449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bed41-8ff0-4d66-879b-067830b75ec6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.619082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1025/2053] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:52.623908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.641026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d1c1-b19c-4015-8f71-d3df51245060 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:52.648663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:52.649264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.649568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.649888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] PATH_INFO: `/v3/projects/9cd414e044a340549130e953695bd8de/users/0d66768f95314d98a98588bf41395388/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.672993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd414e044a340549130e953695bd8de, user_id=0d66768f95314d98a98588bf41395388, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:52.675920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:52.705459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1029/2054] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:52 2022] PUT /identity/v3/projects/9cd414e044a340549130e953695bd8de/users/0d66768f95314d98a98588bf41395388/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:52.728151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:52.728672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:52.729171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:52.819961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] MFA Rules not processed for user `0d66768f95314d98a98588bf41395388`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:52.822773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:52.946048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1026/2055] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:52.953011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.974930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:52.977378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:53.105595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16be37e-d410-4f5b-ae88-4712ab1f411d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.112431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.113272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.113441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.113941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.115154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.117739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.122104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d834104-4749-4f43-9476-9aae19b52892 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.150315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.153351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.153649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.154254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] PATH_INFO: `/v3/projects/a467d195f128422984bf46bfe405627d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.159530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a467d195f128422984bf46bfe405627d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.163050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.189821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1030/2056] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:52 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:53.196285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.218138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:53.298813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a467d195f128422984bf46bfe405627d', 'request_id': 'req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:53.309896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a467d195f128422984bf46bfe405627d', 'request_id': 'req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:53.310415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c248f-536a-402d-9ca7-a38c275ece22 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.322261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a467d195f128422984bf46bfe405627d', 'request_id': 'req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:53.347751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] The token cache is being invalidate because project a467d195f128422984bf46bfe405627d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:53.348354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:53.349681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f0c13fc5-d61a-4525-8eda-2bf41fed0c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:53.352638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1027/2057] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:52 2022] DELETE /identity/v3/projects/a467d195f128422984bf46bfe405627d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:53.361629 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ac7d9-449e-4ece-81cb-add4c9992e42 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.362119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ac7d9-449e-4ece-81cb-add4c9992e42 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.362265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ac7d9-449e-4ece-81cb-add4c9992e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.393020 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d85ac7d9-449e-4ece-81cb-add4c9992e42 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:53.395076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d85ac7d9-449e-4ece-81cb-add4c9992e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:53.401801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:53.430262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.431412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.431859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.432160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.433517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.436813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.473042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1028/2058] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:53.477530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1031/2059] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:53.483225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.484700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.485268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.485731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.487162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:53.505300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab5db9-4680-40c0-9549-3c79328a07c7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.512030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.512237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:53.512779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.513131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.513528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.513874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:53.514473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.516255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.533602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1032/2060] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:53.533936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1029/2061] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:53.535050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.538047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.553661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb377ddc-b287-4617-b8b6-b9befb7a4f38 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.562372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75852-895e-4ab8-bef3-bb330de9cb67 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.563655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.564431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.564839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.565175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.565973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:53.566541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.569438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.572707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.573716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.574707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.575128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.576302 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.579217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.593324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1030/2062] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:53.594499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1033/2063] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:53.595487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.598570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.610089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838971-8571-453e-930f-71ada1e7d54e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.613999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dae9-bdf2-4f28-a4a8-b10b0691a687 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.616357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.618089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.618853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.619305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] PATH_INFO: `/v3/projects/966f7db74f6747098309fd653481bcd6/users/58fe68c4268f4948b7b6a4edc604f973/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.627001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.628312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.630067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.630615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.631364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.633529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.649105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966f7db74f6747098309fd653481bcd6, user_id=58fe68c4268f4948b7b6a4edc604f973, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.652093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef55bdc-e51e-4207-b189-85f1ad2dc148 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.673673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1034/2064] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:53 2022] PUT /identity/v3/projects/966f7db74f6747098309fd653481bcd6/users/58fe68c4268f4948b7b6a4edc604f973/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:53.684271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1031/2065] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:53.690166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.691018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.691316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.691597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.729162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] MFA Rules not processed for user `58fe68c4268f4948b7b6a4edc604f973`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:53.731008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:53.843106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c9c7-c3b8-494c-a65a-fd95116840c5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.850474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.850474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.850797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.851369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.852476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.858804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.883617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:53.894870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1032/2066] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:53.900692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.909185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1035/2067] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:53.916066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.922559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3603-e0d4-4b14-81cc-70fc2de43b0c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.929670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.930402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.930754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.931143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.932157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.935892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.945975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729276-5594-4a16-aad9-c31112c434a0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.953850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.954751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1033/2068] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:53.955360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.955360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.955616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.956825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.959602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:53.960774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:53.977748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01693-3c3c-4816-8544-7a1a80925335 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:53.986806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:53.987311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:53.987602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:53.987884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:53.988542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:53.990211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.003791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1034/2069] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:54.010508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.013877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1036/2070] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:53 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:54.015640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.029439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfee7-8f97-4ac7-ae56-72c55511d0c5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.095029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:54.115199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ec2b-26c2-41bd-a32c-5bceaae1c863 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.133370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.133517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.134153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.134447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.134727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] PATH_INFO: `/v3/projects/1e561d58774b411d8d7880a29f09fe2f/users/bf86b96abad74f79b06539de2d08e67d/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.134883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.135491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.139833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.141133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.144926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.164606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e561d58774b411d8d7880a29f09fe2f, user_id=bf86b96abad74f79b06539de2d08e67d, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.168973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b12a5-13d7-49f0-8bfc-2bae7902a7c6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.185028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1037/2071] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:54 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:53:54.187164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.201513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1035/2072] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:54 2022] PUT /identity/v3/projects/1e561d58774b411d8d7880a29f09fe2f/users/bf86b96abad74f79b06539de2d08e67d/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:54.214574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72856-95b5-40e5-aa12-f1d5a4cee991 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.221312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.221810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.222317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.277865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] MFA Rules not processed for user `bf86b96abad74f79b06539de2d08e67d`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:54.280340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:54.374329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.375013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.375285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.375575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.376245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.379951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.392254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1038/2073] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:54.397207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.438949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89c2ed-67fa-400d-a454-dddc476f636b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.453042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1036/2074] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:54.457065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.457788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.458243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.458527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] PATH_INFO: `/v3/projects/ebf845d175fb489283a62e6aa8d3e54f/users/baf99fabcdcd4ab3a5e352334a3d1685/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.488256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf845d175fb489283a62e6aa8d3e54f, user_id=baf99fabcdcd4ab3a5e352334a3d1685, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.493613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.509369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.511350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:54.519351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1039/2075] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:54 2022] PUT /identity/v3/projects/ebf845d175fb489283a62e6aa8d3e54f/users/baf99fabcdcd4ab3a5e352334a3d1685/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:54.525543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.607094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:54.619448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e68e0-80e5-4464-b1dc-ea1cd3973881 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.663872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b98c3-57be-4529-a369-3500471da384 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.670023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.670678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.671369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.671665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.672344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.674106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.688506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1040/2076] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:53:54.689177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.691048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:54.697544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.698938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.698938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.698938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.730788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:54.786647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac1a6-4e97-4f01-834f-2f0aa03eed8e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.792731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.793514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.794020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.794487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.797296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:54.809252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.812094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.830781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1037/2077] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:54.832117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:54.850351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c51111-ebd5-4b3d-b652-b25eecc63fdc service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:54.857475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:54.858428 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.858696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.858979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] PATH_INFO: `/v3/projects/ebf845d175fb489283a62e6aa8d3e54f/users/baf99fabcdcd4ab3a5e352334a3d1685/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.861047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf845d175fb489283a62e6aa8d3e54f, user_id=baf99fabcdcd4ab3a5e352334a3d1685, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.863735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742697-1735-4432-84b5-948ec1019de3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.879811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1038/2078] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:53:54 2022] PUT /identity/v3/projects/ebf845d175fb489283a62e6aa8d3e54f/users/baf99fabcdcd4ab3a5e352334a3d1685/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:54.882385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:54.884471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:54.892499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:54.892798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:54.893183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:54.904570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1041/2079] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:54.928122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] MFA Rules not processed for user `baf99fabcdcd4ab3a5e352334a3d1685`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:54.929401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:55.047217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1039/2080] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:55.449761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:55.473588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbd78-e470-4e00-a224-4a2ab4221346 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:55.536677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:55.537294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:55.537580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:55.537901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:55.539709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:55.585640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:55.611381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:55.613570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:55.626100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1042/2081] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:57.480643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:57.496641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9626ac7-310a-4bc1-9e16-332ce67d86e3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:57.507439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:57.508074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:57.509963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:57.510410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:57.616779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:57.617309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2948-8b18-45b9-8a6a-a326da4a8dec service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:57.632101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1040/2082] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:57.658653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:57.662558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:57.794854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722e0e6-3796-4fca-8d17-1b77762ceeb0 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:57.804686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:57.805471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:57.806025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:57.806851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] PATH_INFO: `/v3/users/f83ad21779664cd7ad706c46e8add81f` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:57.808747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83ad21779664cd7ad706c46e8add81f)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:57.812413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:57.899795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83ad21779664cd7ad706c46e8add81f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:57.901859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83ad21779664cd7ad706c46e8add81f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:57.925343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83ad21779664cd7ad706c46e8add81f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:57.925343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83ad21779664cd7ad706c46e8add81f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:57.938104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83ad21779664cd7ad706c46e8add81f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:57.964500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1043/2083] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:57 2022] DELETE /identity/v3/users/f83ad21779664cd7ad706c46e8add81f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:57.972609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:57.972853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:57.974146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:57.999494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:58.001904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:58.053267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:58.124506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1041/2084] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:53:58.139956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:58.143073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:58.233689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58809e1-a1c3-4fbd-bb0f-12cbf00c08b3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:58.239421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:58.240241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:58.240533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:58.240816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:58.256760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:58.260970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:58.268019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:58.282029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1044/2085] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:58.729660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:58.731790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:58.758639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51608a1-52f8-455b-beeb-4a0e3e142fcd None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:58.769646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:58.773286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:58.774453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:58.774917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] PATH_INFO: `/v3/projects/0d8c66c55dd84b88898124d109c2cba8` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:58.780755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c66c55dd84b88898124d109c2cba8)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:58.783702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:58.898744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c66c55dd84b88898124d109c2cba8', 'request_id': 'req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:58.908769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c66c55dd84b88898124d109c2cba8', 'request_id': 'req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:58.919065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c66c55dd84b88898124d109c2cba8', 'request_id': 'req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:58.926101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:58.926101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:58.946276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2683-10a4-4304-9b8b-f7b6604c254c service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:58.961015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] The token cache is being invalidate because project 0d8c66c55dd84b88898124d109c2cba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:58.962221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:58.963341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-75d5b92a-9094-48fa-8d6a-ed5df290bbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:58.969195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1042/2086] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:58 2022] DELETE /identity/v3/projects/0d8c66c55dd84b88898124d109c2cba8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:53:58.980678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:58.981146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:58.981569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.040806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:59.046317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.109560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.110513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.111128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.111733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] PATH_INFO: `/v3/users/dcd28af2987548c3a740c7475a37a611` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.114370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd28af2987548c3a740c7475a37a611)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.116578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.190500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1043/2087] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:59.193453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.202120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.214702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd28af2987548c3a740c7475a37a611'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.215988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd28af2987548c3a740c7475a37a611'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.239143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd28af2987548c3a740c7475a37a611'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.240204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd28af2987548c3a740c7475a37a611'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.252392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd28af2987548c3a740c7475a37a611'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.271988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1045/2088] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:58 2022] DELETE /identity/v3/users/dcd28af2987548c3a740c7475a37a611 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:59.273104 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.274612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.302752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607761c1-fd4f-415a-8244-5f31e334cce8 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.311573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.368606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee9ae7-e761-4c4d-bc75-edae93b6d1df admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.376649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.377702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.378223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.378684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] PATH_INFO: `/v3/users/1b7b74f3b6d24b42b3914179c37af5f1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.380316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7b74f3b6d24b42b3914179c37af5f1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.383942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.386125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.387263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.387549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.387808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.389678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.415367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.455558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7b74f3b6d24b42b3914179c37af5f1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.456734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7b74f3b6d24b42b3914179c37af5f1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.476547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7b74f3b6d24b42b3914179c37af5f1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.477629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7b74f3b6d24b42b3914179c37af5f1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.485431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.486978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de10f-d15a-417c-b4e2-68d8fce5bb31 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.488891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d139203-75fd-4d1b-ad58-e23fee79d294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7b74f3b6d24b42b3914179c37af5f1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:59.497582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1044/2089] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:59.498814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101bb-969c-498e-8f01-ca52db5a498f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.499099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101bb-969c-498e-8f01-ca52db5a498f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.499385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc101bb-969c-498e-8f01-ca52db5a498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.506634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1046/2090] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:59 2022] DELETE /identity/v3/users/1b7b74f3b6d24b42b3914179c37af5f1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:59.507759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.508081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.511929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.525621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7cc101bb-969c-498e-8f01-ca52db5a498f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:59.527452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7cc101bb-969c-498e-8f01-ca52db5a498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.530652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:59.532045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.635925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1045/2091] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:59.638461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f287f-8724-4094-8c6e-00743274263d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.638758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f287f-8724-4094-8c6e-00743274263d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.639043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f287f-8724-4094-8c6e-00743274263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.660305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-615f287f-8724-4094-8c6e-00743274263d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:59.660957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1047/2092] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:59.661535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-615f287f-8724-4094-8c6e-00743274263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.662019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.673677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1046/2093] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:59.674918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f287f-8724-4094-8c6e-00743274263d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.676599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-615f287f-8724-4094-8c6e-00743274263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.678149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f23a1-ffe1-4dd9-a607-27f3a7680cc4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.686284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.687301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.687795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.688283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.689505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:53:59.690080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.693125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.711683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1048/2094] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:53:59.712622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.715001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:59.765716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f287f-8724-4094-8c6e-00743274263d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.769980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.770668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.770972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.771255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.783125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.786461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.787999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.802307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1047/2095] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:59.804196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.821413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d6836-0263-4f83-930f-e0a8f05d1d57 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.830832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3315f90-8230-4472-83f4-ee487a9cf9e3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.832281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.833279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.834210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.834680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.835952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.838847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:59.840786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.840927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:59.841350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:59.842017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:59.862466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:59.865867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:59.889155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1049/2096] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:59.901646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1048/2097] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:53:59 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:53:59.904232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:59.924590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628b30-4602-4b44-a44e-8103a2ffbe06 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:59.962295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:00.015538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.017191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.017577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.018406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.019656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.022677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.063541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1050/2098] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:53:59 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:00.065503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.085354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172dd8-e7f6-474c-b818-8803b0d47f13 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.092695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.093439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.093881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.094246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.095313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.097872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.113892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1049/2099] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:00.118578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.133151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c66a2-6ddd-460f-9800-5cbe25250d38 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.140949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.142105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.142694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.143086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.143890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.145875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb212ff6-250e-495c-9d13-46a8626f5cd2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.186353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1051/2100] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:00.192698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.220161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722977a-2f13-4866-9471-f1a4b38c50e2 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.228540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.229581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.231046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.231944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] PATH_INFO: `/v3/projects/478ca9888b1f47098da79fcf15c0904a/users/495c47d01448481ab7a08a566fd46783/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.311097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] RBAC: Authorizing `identity:create_grant(project_id=478ca9888b1f47098da79fcf15c0904a, user_id=495c47d01448481ab7a08a566fd46783, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.317452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.361546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1050/2101] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:00 2022] PUT /identity/v3/projects/478ca9888b1f47098da79fcf15c0904a/users/495c47d01448481ab7a08a566fd46783/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:00.382024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.382536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.382999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.425868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] MFA Rules not processed for user `495c47d01448481ab7a08a566fd46783`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:00.427348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:00.558436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1052/2102] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:00.593836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.594568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:00.631796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.633515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:00.739823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed1ff7-7ef3-4aa4-8252-d3e846ef232c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.748208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.748819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.749347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.749841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.770134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.772194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.793149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb0e84-36ba-4762-a8f1-a40419d8ba1b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.797944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1051/2103] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:00.799742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.801498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.802202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:00.803980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.803980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.803980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] PATH_INFO: `/v3/projects/d5f6cf67f3c54025ba5abf87ec199a94` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.806209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f6cf67f3c54025ba5abf87ec199a94)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.810414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.823074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b77a2d-490f-4d98-8fb0-a888ed2ac09f service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:00.830015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:00.830470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.830836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.831002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] PATH_INFO: `/v3/projects/6f861f773f44455b839ba0bda3b726ac` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:00.832362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f861f773f44455b839ba0bda3b726ac)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:00.834547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:00.900316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:00.918220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f6cf67f3c54025ba5abf87ec199a94', 'request_id': 'req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.937402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f6cf67f3c54025ba5abf87ec199a94', 'request_id': 'req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.937676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f861f773f44455b839ba0bda3b726ac', 'request_id': 'req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.947285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f861f773f44455b839ba0bda3b726ac', 'request_id': 'req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.948429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f6cf67f3c54025ba5abf87ec199a94', 'request_id': 'req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.959968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f861f773f44455b839ba0bda3b726ac', 'request_id': 'req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.974475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] The token cache is being invalidate because project d5f6cf67f3c54025ba5abf87ec199a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:00.975261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.976308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fa9ce8c8-ce17-440f-8c46-a564f3586bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.982657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] The token cache is being invalidate because project 6f861f773f44455b839ba0bda3b726ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:00.982999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.984535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:00.985417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1053/2104] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:00 2022] DELETE /identity/v3/projects/d5f6cf67f3c54025ba5abf87ec199a94 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:00.986733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1052/2105] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:00 2022] DELETE /identity/v3/projects/6f861f773f44455b839ba0bda3b726ac => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:00.991996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc0df-34cc-41c6-8dd0-b3e51dbe92d7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:00.993062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:00.994242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc0df-34cc-41c6-8dd0-b3e51dbe92d7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:00.994868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:00.995322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cc0df-34cc-41c6-8dd0-b3e51dbe92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.030636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e31cc0df-34cc-41c6-8dd0-b3e51dbe92d7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:01.033694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e31cc0df-34cc-41c6-8dd0-b3e51dbe92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:01.037690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:01.097891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735c6b-9e6c-4d78-8bf7-9a706b4927cb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.122469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.123593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.124070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.125039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] PATH_INFO: `/v3/users/dcba780d4f1742cb88545c413cbff820` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.128208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba780d4f1742cb88545c413cbff820)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.131685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.194153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1054/2106] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:01.204495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.204495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.204930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.221854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba780d4f1742cb88545c413cbff820'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.222535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba780d4f1742cb88545c413cbff820'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.223960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba780d4f1742cb88545c413cbff820'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.248534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:01.251837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:01.252564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba780d4f1742cb88545c413cbff820'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.264537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba780d4f1742cb88545c413cbff820'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:01.265339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1055/2107] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:01.271035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.285173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1663d4-53fc-40ba-aac6-5edd2d47dcc4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.289646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1053/2108] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:00 2022] DELETE /identity/v3/users/dcba780d4f1742cb88545c413cbff820 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:01.303143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.304065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.305142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.305581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.307054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:01.307695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.310294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.327696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1056/2109] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:01.332872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.525875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44939e-189c-4546-b40d-b07cb50f19e1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.535994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.536967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.537450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.537968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.539323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.543084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.609310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1054/2110] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:01 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:01.614185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.631221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfb0-a60d-48d1-ad8d-08bd630235d1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.750260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.750732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.751111 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.751478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.752346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.754571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.795734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1057/2111] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:01 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:01.800526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.815490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9869b-4bfd-4773-95cf-5e05c1e2afd9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.826122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.827344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.827912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.828426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.829497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.831931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.846122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1055/2112] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:01.851655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.870255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7151-3d5b-40f3-ad50-d118724b79a3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.877949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.878860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.879381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.879791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.880932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.883545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.889201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.891841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:01.903934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1058/2113] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:01.909858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:01.921963 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a6e2-d484-4260-a945-13ffd1f825c8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.922997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e21e6-d6c7-4224-94a4-14a57b8b7e74 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:01.929283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.930408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.931387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.931686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] PATH_INFO: `/v3/projects/22e0aef948944afc8e3ed5b2867ee39a/users/f36a1e4878504cf3ac47ccfc7bd4c3d4/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.940794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:01.951923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:01.952658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:01.953366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] PATH_INFO: `/v3/projects/2a62ddc726034849ae8b3751fb115591` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:01.956661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a62ddc726034849ae8b3751fb115591)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:01.974247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:01.997063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:01.999954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e0aef948944afc8e3ed5b2867ee39a, user_id=f36a1e4878504cf3ac47ccfc7bd4c3d4, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:02.005740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3319a4-e0d3-45c1-8af0-fd6d9e30dc4c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:02.029351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1059/2114] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:01 2022] PUT /identity/v3/projects/22e0aef948944afc8e3ed5b2867ee39a/users/f36a1e4878504cf3ac47ccfc7bd4c3d4/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:02.051529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.052038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.052522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.056406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a62ddc726034849ae8b3751fb115591', 'request_id': 'req-8df2146f-7695-4626-835b-e254117ce1a0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.066835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:02.071394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a62ddc726034849ae8b3751fb115591', 'request_id': 'req-8df2146f-7695-4626-835b-e254117ce1a0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.079773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a62ddc726034849ae8b3751fb115591', 'request_id': 'req-8df2146f-7695-4626-835b-e254117ce1a0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.097401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] The token cache is being invalidate because project 2a62ddc726034849ae8b3751fb115591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:02.097704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.098429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.100469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1056/2115] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:01 2022] DELETE /identity/v3/projects/2a62ddc726034849ae8b3751fb115591 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:02.104117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:02.105511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.111106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] MFA Rules not processed for user `f36a1e4878504cf3ac47ccfc7bd4c3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:02.114029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.194395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2146f-7695-4626-835b-e254117ce1a0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:02.200208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:02.200859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.201199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.201503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] PATH_INFO: `/v3/users/9e8ecf8045c44c81b85a4f49f0e2907a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.202781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8ecf8045c44c81b85a4f49f0e2907a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:02.204846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:02.225364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1060/2116] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:02.243074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:02.245982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.288520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8ecf8045c44c81b85a4f49f0e2907a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.289744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8ecf8045c44c81b85a4f49f0e2907a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.290825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8ecf8045c44c81b85a4f49f0e2907a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.309716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8ecf8045c44c81b85a4f49f0e2907a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.321553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4d63c8ce-8354-468b-a611-12b0aed4e842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8ecf8045c44c81b85a4f49f0e2907a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:02.343237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1057/2117] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:02 2022] DELETE /identity/v3/users/9e8ecf8045c44c81b85a4f49f0e2907a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:02.385479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612d64-cbe2-43cb-9c1d-e2b9a3019aa5 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:02.511816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:02.514567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.515012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.515484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.518439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.566702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256f46-1167-4293-8a64-c02eef38b895 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:02.566989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256f46-1167-4293-8a64-c02eef38b895 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:02.567266 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256f46-1167-4293-8a64-c02eef38b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:02.599183 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e2256f46-1167-4293-8a64-c02eef38b895 None None] MFA Rules not processed for user `495c47d01448481ab7a08a566fd46783`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:02.600431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e2256f46-1167-4293-8a64-c02eef38b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:02.620443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:02.632248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:02.733651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:02.736746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:02.754697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1061/2118] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:02.775420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1058/2119] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:02.919115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:02.920840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:03.036694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7b63-f20b-496e-9a08-474ec0cc5d8a service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.044759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.054563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.055058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.055525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] PATH_INFO: `/v3/projects/6b45b97a461a4796a78ede0884242eb3` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.057196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b45b97a461a4796a78ede0884242eb3)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.059936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.143831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b45b97a461a4796a78ede0884242eb3', 'request_id': 'req-5350764a-7f84-49b7-bad5-f014b2f2792f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.154261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b45b97a461a4796a78ede0884242eb3', 'request_id': 'req-5350764a-7f84-49b7-bad5-f014b2f2792f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.164032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b45b97a461a4796a78ede0884242eb3', 'request_id': 'req-5350764a-7f84-49b7-bad5-f014b2f2792f'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.181556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] The token cache is being invalidate because project 6b45b97a461a4796a78ede0884242eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:03.181832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.183812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5350764a-7f84-49b7-bad5-f014b2f2792f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:03.194942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.196037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.196820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.208429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1062/2120] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:02 2022] DELETE /identity/v3/projects/6b45b97a461a4796a78ede0884242eb3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:03.241506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:03.243962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:03.386619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1059/2121] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:03.396478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.397024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.397964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.426959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:03.428377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:03.439778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1063/2122] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:03.444412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.468694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c9e94-15da-477b-bd8c-f80290f4d015 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.483342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.488170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.488994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.489994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.491942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:03.493430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.498300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.527310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1060/2123] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:03.535635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.565714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a817f-54f1-46ba-bff2-0444beb31b10 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.575087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.576134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.576607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.577088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.578359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.580993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.629674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.630343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1064/2124] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:03 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:03.648547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb4d20-d784-45d2-9c3b-e301b323e482 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.773388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.775841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.777201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.777865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.780060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.785891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.854303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1061/2125] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:03 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:03.860940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.889130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e1e2-eaea-4740-a5e6-b8b666bc5903 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.897839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.898594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.899081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.899582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.901120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.904829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.927965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1065/2126] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:03.929619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.946994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3c1a4-3ffc-4f3f-8fe3-0720f6a7a15c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.953236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.954416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.954868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.955029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.955615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.957478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7289a7-95b5-4180-9379-54b2a51a0446 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.970486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1062/2127] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:03.977546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.989629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d147c15-f0a1-49f5-87bc-68adead0a627 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.995150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.995972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.996291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.996676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] PATH_INFO: `/v3/projects/c642d95753e34d5890cbc237bdc3206c/users/0538970d143f457fa349393b58da490c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.016292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c642d95753e34d5890cbc237bdc3206c, user_id=0538970d143f457fa349393b58da490c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.019393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.022556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:04.038364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1066/2128] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:03 2022] PUT /identity/v3/projects/c642d95753e34d5890cbc237bdc3206c/users/0538970d143f457fa349393b58da490c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:04.053602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.054178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.054634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.100994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] MFA Rules not processed for user `0538970d143f457fa349393b58da490c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:04.102793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:04.143786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:04.214993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1063/2129] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:04.221724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.319155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382b00-a9f1-4bae-b33e-a6bcb97de68e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.327341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:04.328110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.328537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.328952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.329888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.332014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.369155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1067/2130] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:04 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:04.384676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.406149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffd8e8-2261-4aab-9e15-0d34864e5067 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.500967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.504183 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:04.530687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:04.531762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.532360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.532906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.534252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.538115 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.583494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1064/2131] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:04 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:04.591766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.622282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb55f-2455-4b0b-9f76-0fcc26f7b90b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.631048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:04.632099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.632733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.633315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.634417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.637273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.661877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1065/2132] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:04.664166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.674292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed05b7-0bed-4b3e-83a3-e926fad4799e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.681524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80d23-ed98-496a-bb38-097aa7c5f39a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.684277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:04.685435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.685976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.686513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] PATH_INFO: `/v3/users/0d66768f95314d98a98588bf41395388` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.690361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d66768f95314d98a98588bf41395388)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.692822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:04.694226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.694738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.695179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] PATH_INFO: `/v3/projects/43404e3911b9471aa4578307d23f55e6/users/57fffcf1db42439c88da8f9c106db5dd/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.698903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.716003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43404e3911b9471aa4578307d23f55e6, user_id=57fffcf1db42439c88da8f9c106db5dd, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:04.719116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:04.738840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1066/2133] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:04 2022] PUT /identity/v3/projects/43404e3911b9471aa4578307d23f55e6/users/57fffcf1db42439c88da8f9c106db5dd/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:04.742674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:04.799646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d66768f95314d98a98588bf41395388'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:04.801133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d66768f95314d98a98588bf41395388'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:04.834893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d66768f95314d98a98588bf41395388'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:04.836179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d66768f95314d98a98588bf41395388'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:04.864241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-92c76b75-5d23-478f-957a-18a06cb2dea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d66768f95314d98a98588bf41395388'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:04.884716 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:04.897660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1068/2134] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:04 2022] DELETE /identity/v3/users/0d66768f95314d98a98588bf41395388 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:04.904945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:04.907711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:04.908463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:04.911968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ca99-4a10-4437-94ee-c0b930048119 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:04.973892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:04.978899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:04.988752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:05.100226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:05.101086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.101885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.102363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.103534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:05.105655 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:05.125815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1067/2135] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:05.126554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1069/2136] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:05.129384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:05.132118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:05.139512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:05.145050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:05.163383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865191e-1ea6-415c-a9f9-c1155bad63be admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:05.175288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:05.176696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.177300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.177930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] PATH_INFO: `/v3/projects/43404e3911b9471aa4578307d23f55e6/users/57fffcf1db42439c88da8f9c106db5dd/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.182140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43404e3911b9471aa4578307d23f55e6, user_id=57fffcf1db42439c88da8f9c106db5dd, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:05.192642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95790e-fb74-4a79-9281-2701c09581c0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:05.213601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1068/2137] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:05 2022] PUT /identity/v3/projects/43404e3911b9471aa4578307d23f55e6/users/57fffcf1db42439c88da8f9c106db5dd/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:05.226786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.227876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.228341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.310525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] MFA Rules not processed for user `57fffcf1db42439c88da8f9c106db5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:05.312448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:05.320374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1d593-57e7-4d4d-88e3-47d6e658f9eb None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:05.401456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:05.403408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.403810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.404100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.440792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1069/2138] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:05.465612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:05.467182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:05.519305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:05.520815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:05.534387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1070/2139] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:05.646717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c40a2-a0eb-413b-aaa1-e25e8737b3e9 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:05.657514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:05.659038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.659675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.660253 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.678530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:05.685244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:05.708712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1070/2140] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:54:05.923263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:05.935266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:05.939988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6fac-07c3-423e-ad26-9fe6976b8a7d service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:05.945902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:05.946890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:05.947243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:05.947596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] PATH_INFO: `/v3/users/0538970d143f457fa349393b58da490c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:05.949364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0538970d143f457fa349393b58da490c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:05.951449 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.026480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:06.028764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.038883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0538970d143f457fa349393b58da490c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.039643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0538970d143f457fa349393b58da490c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.055008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902207-b816-48a7-8fc8-c76985dc3ab4 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:06.061545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:06.062312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.062790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.063284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] PATH_INFO: `/v3/projects/9cd414e044a340549130e953695bd8de` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.064094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0538970d143f457fa349393b58da490c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.065240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0538970d143f457fa349393b58da490c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.065407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd414e044a340549130e953695bd8de)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:06.071202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.089696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-9d651db5-e233-476a-baf0-e3ca0203d9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0538970d143f457fa349393b58da490c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.122559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1071/2141] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:05 2022] DELETE /identity/v3/users/0538970d143f457fa349393b58da490c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:06.124459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.124795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.125076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.139664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:06.165834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:06.165834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.176384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd414e044a340549130e953695bd8de', 'request_id': 'req-69e8bc35-5800-4cfa-b001-714dea73ab9f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.188018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd414e044a340549130e953695bd8de', 'request_id': 'req-69e8bc35-5800-4cfa-b001-714dea73ab9f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.195628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd414e044a340549130e953695bd8de', 'request_id': 'req-69e8bc35-5800-4cfa-b001-714dea73ab9f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.238525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] The token cache is being invalidate because project 9cd414e044a340549130e953695bd8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:06.238525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.238525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.238525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1071/2142] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:06 2022] DELETE /identity/v3/projects/9cd414e044a340549130e953695bd8de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:06.238525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:06.240238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.346604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1072/2143] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:06.431089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bc35-5800-4cfa-b001-714dea73ab9f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:06.439453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:06.441440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.452472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:06.454831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.455202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.456465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] PATH_INFO: `/v3/users/58fe68c4268f4948b7b6a4edc604f973` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.469965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58fe68c4268f4948b7b6a4edc604f973)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:06.469965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.574617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58fe68c4268f4948b7b6a4edc604f973'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.575474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58fe68c4268f4948b7b6a4edc604f973'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.576405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58fe68c4268f4948b7b6a4edc604f973'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.595230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58fe68c4268f4948b7b6a4edc604f973'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.595529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e5b8-8efe-4d0b-9914-5158c0b6347d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:06.602088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:06.603341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.603659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.603914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.606301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.608128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58fe68c4268f4948b7b6a4edc604f973'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.623418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:06.625179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8fac-6fe3-4839-a694-96314d262646 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.627628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1072/2144] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:06 2022] DELETE /identity/v3/users/58fe68c4268f4948b7b6a4edc604f973 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:06.643067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1073/2145] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:06.708038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:06.709991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.795426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:06.842994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d84fb-1478-477e-8404-6b887435466d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:06.858503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:06.859764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.860258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.860828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] PATH_INFO: `/v3/users/f36a1e4878504cf3ac47ccfc7bd4c3d4` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.862515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36a1e4878504cf3ac47ccfc7bd4c3d4)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:06.865515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.965532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36a1e4878504cf3ac47ccfc7bd4c3d4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.967387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36a1e4878504cf3ac47ccfc7bd4c3d4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.968718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36a1e4878504cf3ac47ccfc7bd4c3d4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:06.990595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36a1e4878504cf3ac47ccfc7bd4c3d4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.008794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36a1e4878504cf3ac47ccfc7bd4c3d4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.031538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1073/2146] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:06 2022] DELETE /identity/v3/users/f36a1e4878504cf3ac47ccfc7bd4c3d4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:07.037724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.038254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.038622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.062141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:07.063775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.106798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:07.248942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1074/2147] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:07.288174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:07.293514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.374495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a76f-2eee-4f14-b6fb-927dcfdc9682 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:07.380831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:07.381577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.382066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.382708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.402218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:07.403948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.421697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e615b-bd82-4705-99d6-bcb106bbbf48 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:07.423240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:07.424956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:07.428446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:07.430750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.441911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.442802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] PATH_INFO: `/v3/projects/966f7db74f6747098309fd653481bcd6` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.447106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1074/2148] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:07.448030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:07.449876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966f7db74f6747098309fd653481bcd6)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:07.455229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.458061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:07.481550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb50a-f199-4153-a5c9-e6ae25416da1 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:07.493691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:07.494508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.494927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.495800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] PATH_INFO: `/v3/projects/c642d95753e34d5890cbc237bdc3206c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.501818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c642d95753e34d5890cbc237bdc3206c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:07.508093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:07.627982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c642d95753e34d5890cbc237bdc3206c', 'request_id': 'req-a306f056-febf-4282-9af7-8e2472c7a03e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.631175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:07.637622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966f7db74f6747098309fd653481bcd6', 'request_id': 'req-c6f9e878-3e84-4ee8-b28c-635f32e77f31'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.638125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c642d95753e34d5890cbc237bdc3206c', 'request_id': 'req-a306f056-febf-4282-9af7-8e2472c7a03e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.647373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c642d95753e34d5890cbc237bdc3206c', 'request_id': 'req-a306f056-febf-4282-9af7-8e2472c7a03e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.666690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966f7db74f6747098309fd653481bcd6', 'request_id': 'req-c6f9e878-3e84-4ee8-b28c-635f32e77f31'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.671581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] The token cache is being invalidate because project c642d95753e34d5890cbc237bdc3206c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:07.671867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.673909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.677804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1075/2149] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:07 2022] DELETE /identity/v3/projects/c642d95753e34d5890cbc237bdc3206c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:07.678233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966f7db74f6747098309fd653481bcd6', 'request_id': 'req-c6f9e878-3e84-4ee8-b28c-635f32e77f31'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.685073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:07.690380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.696222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] The token cache is being invalidate because project 966f7db74f6747098309fd653481bcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:07.697427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.698513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:07.701649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1075/2150] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:07 2022] DELETE /identity/v3/projects/966f7db74f6747098309fd653481bcd6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:07.706627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:07.708630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:07.875876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9e878-3e84-4ee8-b28c-635f32e77f31 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:07.881936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f056-febf-4282-9af7-8e2472c7a03e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:07.885056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:07.886474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.886932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.888588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] PATH_INFO: `/v3/users/baf99fabcdcd4ab3a5e352334a3d1685` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.890595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf99fabcdcd4ab3a5e352334a3d1685)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:07.893432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:07.894417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:07.895167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:07.895594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:07.896222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] PATH_INFO: `/v3/users/57fffcf1db42439c88da8f9c106db5dd` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:07.898867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fffcf1db42439c88da8f9c106db5dd)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:07.902222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:08.023585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:08.028598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf99fabcdcd4ab3a5e352334a3d1685'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.030092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf99fabcdcd4ab3a5e352334a3d1685'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.035703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fffcf1db42439c88da8f9c106db5dd'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.037898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fffcf1db42439c88da8f9c106db5dd'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.039710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fffcf1db42439c88da8f9c106db5dd'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.059119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf99fabcdcd4ab3a5e352334a3d1685'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.060540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf99fabcdcd4ab3a5e352334a3d1685'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.072529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fffcf1db42439c88da8f9c106db5dd'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.076785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf99fabcdcd4ab3a5e352334a3d1685'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.092444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-83b5103b-f03e-47e9-a844-8d2536ac499c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fffcf1db42439c88da8f9c106db5dd'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.131649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1076/2151] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:07 2022] DELETE /identity/v3/users/baf99fabcdcd4ab3a5e352334a3d1685 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:08.133604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1076/2152] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:07 2022] DELETE /identity/v3/users/57fffcf1db42439c88da8f9c106db5dd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:08.188984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:08.191792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:08.335510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e454-aaf9-4d14-ba7c-c9e06d9b07bb admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:08.434645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:08.435592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.435895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.436269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] PATH_INFO: `/v3/projects/22e0aef948944afc8e3ed5b2867ee39a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.437705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e0aef948944afc8e3ed5b2867ee39a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:08.440238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:08.516949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e0aef948944afc8e3ed5b2867ee39a', 'request_id': 'req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.524565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e0aef948944afc8e3ed5b2867ee39a', 'request_id': 'req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.533747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e0aef948944afc8e3ed5b2867ee39a', 'request_id': 'req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.546427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:08.553480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] The token cache is being invalidate because project 22e0aef948944afc8e3ed5b2867ee39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:08.553992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.555007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-77aed6c7-b4e9-45e9-9d2a-b2c7b48939c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:08.561214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1077/2153] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:08 2022] DELETE /identity/v3/projects/22e0aef948944afc8e3ed5b2867ee39a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:08.563491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.563980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.564072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.598259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:08.600613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:08.687414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:08.713853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.714651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.714902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.719394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1077/2154] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:08.742085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:08.743366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:08.762453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1078/2155] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:08.764519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:08.780290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8885-5d17-4011-aee5-e360db643ac6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:08.788887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:08.790237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.790810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.791276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.792512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:08.793062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:08.796273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:08.832581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1078/2156] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:08.840137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:08.860505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebde39-56ef-4349-91b8-017dae1928f0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:08.873079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:08.873079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.873079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.873079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.874176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:08.874483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:08.876674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:08.889915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:08.951509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409633-0403-4dc7-b1db-3d0996710443 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:08.974682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:08.977068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:08.977729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:08.978325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] PATH_INFO: `/v3/projects/43404e3911b9471aa4578307d23f55e6` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:08.981046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43404e3911b9471aa4578307d23f55e6)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:08.987184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:08.991122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1079/2157] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:08 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:08.994653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.001231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.098659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43404e3911b9471aa4578307d23f55e6', 'request_id': 'req-ef0be56d-9293-4bcb-8516-0923b4386040'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.110370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43404e3911b9471aa4578307d23f55e6', 'request_id': 'req-ef0be56d-9293-4bcb-8516-0923b4386040'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.123667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43404e3911b9471aa4578307d23f55e6', 'request_id': 'req-ef0be56d-9293-4bcb-8516-0923b4386040'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.126113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff39-8483-4561-89de-82e37eac33ac admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.145501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] The token cache is being invalidate because project 43404e3911b9471aa4578307d23f55e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:09.145967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.146994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.170490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1079/2158] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:08 2022] DELETE /identity/v3/projects/43404e3911b9471aa4578307d23f55e6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:09.171642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.173164 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.230240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.231225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.231711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.232132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] PATH_INFO: `/v3/projects/ebf845d175fb489283a62e6aa8d3e54f` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.233936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf845d175fb489283a62e6aa8d3e54f)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.236818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.313180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be56d-9293-4bcb-8516-0923b4386040 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.321686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.322811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.323908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.324471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.325644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.329342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33100a-620b-4c1d-b87e-6e53cbe608f4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.341799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf845d175fb489283a62e6aa8d3e54f', 'request_id': 'req-a8da0d83-f99c-44cc-870b-78011ffaee23'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.360531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf845d175fb489283a62e6aa8d3e54f', 'request_id': 'req-a8da0d83-f99c-44cc-870b-78011ffaee23'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.378022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1080/2159] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:09.378022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750451-1bd0-4c99-ad82-91fbc1b8d7c5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.383301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750451-1bd0-4c99-ad82-91fbc1b8d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.383918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750451-1bd0-4c99-ad82-91fbc1b8d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.391077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf845d175fb489283a62e6aa8d3e54f', 'request_id': 'req-a8da0d83-f99c-44cc-870b-78011ffaee23'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.411705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-be750451-1bd0-4c99-ad82-91fbc1b8d7c5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:09.412661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-be750451-1bd0-4c99-ad82-91fbc1b8d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.430690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] The token cache is being invalidate because project ebf845d175fb489283a62e6aa8d3e54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:09.431382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.436077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:09.440203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1080/2160] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:08 2022] DELETE /identity/v3/projects/ebf845d175fb489283a62e6aa8d3e54f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:09.441464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.447834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.481580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:09.501852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:09.526336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1081/2161] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:09.528519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e460d5-5544-4db5-ab61-8b3bdfabac9f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.528917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e460d5-5544-4db5-ab61-8b3bdfabac9f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.529158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e460d5-5544-4db5-ab61-8b3bdfabac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.583446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-70e460d5-5544-4db5-ab61-8b3bdfabac9f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:09.589960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-70e460d5-5544-4db5-ab61-8b3bdfabac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.606907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1082/2162] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:09.609369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.610212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.610642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.614117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0d83-f99c-44cc-870b-78011ffaee23 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.627498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.628605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.629069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.629531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.630635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.632665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed234-a40b-42b9-ae70-ace19544a639 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.649277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1081/2163] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:09.649277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.649277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.649277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.650305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:09.652458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.665444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1083/2164] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:09.666481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.677372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:09.678992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.679705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca3fa0-f880-41be-a5f6-96403cc2fd5c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.688979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.689894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.690378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.690758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.691627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.694219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.697243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1082/2165] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:09.698290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.712852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1084/2166] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:09.715034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.720014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccc7ff-9468-4cdd-b039-8b23334b98bf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.727833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.728551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.728912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.729187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.730547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:09.730833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.731542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2a762-3416-49ee-89b3-90fe659768ef admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.732543 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.736723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.737408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.737783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.738080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.738734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:09.739045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.740757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.751617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1083/2167] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:09.751617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.759586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1085/2168] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:09.760920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.773070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352546d-cd6b-432c-bdd0-f5056d1210bd admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.779687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.780401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb63dba-7090-479c-b26d-589fae14e743 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.780562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.780562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.780866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] PATH_INFO: `/v3/projects/1f4fe462f5784d61bbf6afd54ef262dc/users/fa53ebdc14c447f3b8aa624f4c1c3169/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.787854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.788978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.789404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.789870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.791088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.795464 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadd5f2-d588-4b3f-8943-5f753c400638 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.801445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4fe462f5784d61bbf6afd54ef262dc, user_id=fa53ebdc14c447f3b8aa624f4c1c3169, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.804935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:09.824940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1084/2169] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:09 2022] PUT /identity/v3/projects/1f4fe462f5784d61bbf6afd54ef262dc/users/fa53ebdc14c447f3b8aa624f4c1c3169/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:09.834802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.841550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1086/2170] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:09.844055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.844611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.845104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.891782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] MFA Rules not processed for user `fa53ebdc14c447f3b8aa624f4c1c3169`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:09.893016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:09.915025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e01f7-fbda-46ff-96f0-395fed2fabfd admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:09.985844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1087/2171] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:09.985844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:09.994938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:09.995526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:09.995883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:09.996230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:09.996931 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:09.998945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.016978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:10.036569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1085/2172] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:10.037756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.082185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1676-8967-4991-98b9-1bbf15ae9656 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.122048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:10.128837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ca8f-be54-40ba-b111-8d8b7b925ea7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.137558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.138226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.138513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.138796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.139439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.141355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.158002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.158693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.158982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.159260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.160314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.164175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.177393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1086/2173] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:10.178311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.196955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1088/2174] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:09 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:10.199486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.213169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f6ef2-fa79-406a-a937-0d63647ffee3 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.264350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0da5-c1cb-4cb2-84e3-2ac05c20534b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.275946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.277399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.277686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.278037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.278693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.280702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.296893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.297705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.298113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.298507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.299692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.303745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.307097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1087/2175] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:10.308210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.320355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ee-3cbf-4d8f-bdf3-859b1d7032c9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.326910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.327565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.327878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.328156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.328884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.331146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.348578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1089/2176] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:10.348578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.350809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1088/2177] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.352288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.363678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8784f1-f141-4303-889c-7af45efda971 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.365929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e5bd-dbbd-46e6-a250-2552ae852a5c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.371626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.372426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.372698 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.373044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.373799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.375515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.378809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.379113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.379546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.380046 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.381327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.388620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.395043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1090/2178] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.395043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.407318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1089/2179] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.407607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4a9b-c7b7-44bb-a739-18a7dbfe7df7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.407791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.413537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.414567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.415003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.416054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.416525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.419103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.421573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7162-cded-490b-bd38-8e90383c52c1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.426943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.427564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.427845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.428124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.428799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.431582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.443607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1091/2180] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.444576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.446097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1090/2181] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.451500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.462000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1304-4971-47f4-851d-19510ad21d62 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.468997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c502-96c5-487e-8166-d2dea27d8b72 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.470922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.471749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.472125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.472765 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.473541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.476210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.478142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.479054 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.479610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.479920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] PATH_INFO: `/v3/projects/d2ee866f2c3e41a89dca20388114fcf4/users/b8bd0aa0586447689148a35c9865f893/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.505124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1092/2182] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:10.505422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ee866f2c3e41a89dca20388114fcf4, user_id=b8bd0aa0586447689148a35c9865f893, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.505580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.505727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.527244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299bc35-02a1-4689-8fdb-59541d9943b9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.530035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1091/2183] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:10 2022] PUT /identity/v3/projects/d2ee866f2c3e41a89dca20388114fcf4/users/b8bd0aa0586447689148a35c9865f893/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:10.530868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.580694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:10.652176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.652727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.655288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.656425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] PATH_INFO: `/v3/projects/d76e68c5833b478ab484067fa79d74ed/users/84382431af084e569e482e89272b2a48/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.697546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76e68c5833b478ab484067fa79d74ed, user_id=84382431af084e569e482e89272b2a48, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.700912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4557ce-6d02-458b-83e2-521aafec1f18 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:10.709823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bd93b-a459-40b4-afc3-162d4a71c6e3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.713433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:10.714314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.714668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.718191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] PATH_INFO: `/v3/projects/f739099f9d7444f1a85f1c9abeef5c71/users/6774eab1a15d4b1cbbcc4d258daad142/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.741156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1093/2184] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:10 2022] PUT /identity/v3/projects/d76e68c5833b478ab484067fa79d74ed/users/84382431af084e569e482e89272b2a48/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:10.743500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b87f-d433-40fc-be0e-762ea6a147fe None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.743776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b87f-d433-40fc-be0e-762ea6a147fe None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.744153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b87f-d433-40fc-be0e-762ea6a147fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.749300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f739099f9d7444f1a85f1c9abeef5c71, user_id=6774eab1a15d4b1cbbcc4d258daad142, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:10.753206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d29c0-82d2-484e-9d44-d21b1030826f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:10.773741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:10.783769 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1092/2185] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:10 2022] PUT /identity/v3/projects/f739099f9d7444f1a85f1c9abeef5c71/users/6774eab1a15d4b1cbbcc4d258daad142/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:10.784289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.784692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.785167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.802604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b614b87f-d433-40fc-be0e-762ea6a147fe None None] MFA Rules not processed for user `b8bd0aa0586447689148a35c9865f893`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:10.803873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b614b87f-d433-40fc-be0e-762ea6a147fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:10.835643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] MFA Rules not processed for user `84382431af084e569e482e89272b2a48`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:10.836885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:10.918443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1094/2186] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:10.918443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:10.918443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:10.918443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:10.937396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1093/2187] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:10.938030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:10.966297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] MFA Rules not processed for user `6774eab1a15d4b1cbbcc4d258daad142`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:10.968457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:11.044935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbf4d-3b05-4500-8083-fc460009371d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.053855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.054951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.055436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.055922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.057192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.060207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.075965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1095/2188] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:11.076965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.079356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:11.105800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1094/2189] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:10 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:11.106906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.121322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:11.181866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fbc26-8214-4150-8e57-d5c2d6d8a9d2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.191209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce935-23b7-4140-850e-6cec96b66f79 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.197245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.198767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.199148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.199529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.200335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.202656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.247251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1095/2190] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:11 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:11.250528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.265198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:11.279433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.280227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.280584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.280929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.349989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed3601-66c0-405a-b83e-44ab0e171a48 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.350828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.352367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.355835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.356789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.357246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.357706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.358399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.361749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.364191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1096/2191] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:11.367584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.386702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd950-7cf8-4593-8baf-d506feeb310d service glance] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.394143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.394780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.395060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.395338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.395988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.398297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1096/2192] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:11 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:11.401849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.403609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.420080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8870b-57b2-463b-8282-fe2837128571 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.433349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.434642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.434925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.435347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.436799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.441292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.456369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1097/2193] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:11 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:11.463505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1097/2194] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:11.464237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.469029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.484067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331955b5-e9ae-4ca2-b0f2-df3ab8bc48b6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.491276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfbcb-578c-47e8-be22-5240e4127c11 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.491756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.493305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.493637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.494075 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] PATH_INFO: `/v3/projects/0d8663d8e3824b87afe484d687ec46e5/users/de6d0e5077c142a6b76ff248ab293f8b/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.498179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.500022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.500436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.500824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.507890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.510724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.517343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8663d8e3824b87afe484d687ec46e5, user_id=de6d0e5077c142a6b76ff248ab293f8b, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.520838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.524992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1098/2195] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:11.532447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.547289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1098/2196] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:11 2022] PUT /identity/v3/projects/0d8663d8e3824b87afe484d687ec46e5/users/de6d0e5077c142a6b76ff248ab293f8b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:11.554014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.562640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2c261-82cb-48d5-b193-d22d0e9a47d1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.650724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.652017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.652381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.653247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] PATH_INFO: `/v3/projects/9bfa00c905c84fe08515b25876c68c8b/users/0a02cafa9e7849d18d00cba6ad0000d2/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.688088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfa00c905c84fe08515b25876c68c8b, user_id=0a02cafa9e7849d18d00cba6ad0000d2, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.692009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.703653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:11.731902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1099/2197] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:11 2022] PUT /identity/v3/projects/9bfa00c905c84fe08515b25876c68c8b/users/0a02cafa9e7849d18d00cba6ad0000d2/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:11.743840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:11.749370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2c116-a665-4b71-962a-0392b54ed0d1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.919983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:11.945608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949c06-5a0a-4d4d-852b-581e9402e612 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:11.950838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.951642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.952002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.952436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.953223 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.955349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:11.955699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.956959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:11.957457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:11.958145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:11.960344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:11.964501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:11.997185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1100/2198] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:12.000228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1099/2199] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:12.000902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:12.003521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:12.024342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6980-2b06-4a64-8080-8736f3e0dd1f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:12.038324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:12.044846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.045918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cd8d2-efcf-4191-8a5e-d37f1abd9e19 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:12.046066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.046978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] PATH_INFO: `/v3/projects/0d8663d8e3824b87afe484d687ec46e5/users/de6d0e5077c142a6b76ff248ab293f8b/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.051515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8663d8e3824b87afe484d687ec46e5, user_id=de6d0e5077c142a6b76ff248ab293f8b, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:12.055924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7e2f6-7bfb-48a6-9b97-a0abef63c3c5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:12.058416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:12.060343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.060343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.060852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] PATH_INFO: `/v3/projects/9bfa00c905c84fe08515b25876c68c8b/users/0a02cafa9e7849d18d00cba6ad0000d2/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.067474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfa00c905c84fe08515b25876c68c8b, user_id=0a02cafa9e7849d18d00cba6ad0000d2, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:12.074033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17600e98-4a9c-4b95-babc-33c02ca40b6f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:12.092254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1100/2200] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:12 2022] PUT /identity/v3/projects/9bfa00c905c84fe08515b25876c68c8b/users/0a02cafa9e7849d18d00cba6ad0000d2/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:12.103018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554c5f-c123-4820-a7df-d03294581415 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.103373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554c5f-c123-4820-a7df-d03294581415 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.103596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554c5f-c123-4820-a7df-d03294581415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.108017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1101/2201] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:11 2022] PUT /identity/v3/projects/0d8663d8e3824b87afe484d687ec46e5/users/de6d0e5077c142a6b76ff248ab293f8b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:12.121383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.122434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.123034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.182191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-53554c5f-c123-4820-a7df-d03294581415 None None] MFA Rules not processed for user `0a02cafa9e7849d18d00cba6ad0000d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:12.183855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-53554c5f-c123-4820-a7df-d03294581415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:12.243058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] MFA Rules not processed for user `de6d0e5077c142a6b76ff248ab293f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:12.244354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:12.332552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1101/2202] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:12.378070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53554c5f-c123-4820-a7df-d03294581415 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:12.379852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-53554c5f-c123-4820-a7df-d03294581415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:12.463260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1102/2203] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:12.475598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:12.477208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:12.501853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53554c5f-c123-4820-a7df-d03294581415 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:12.508291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:12.509360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.509920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.510460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.527563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:12.530355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:12.550455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1102/2204] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:12.553011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41b30-b24c-4a18-8887-f053c3e08645 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:12.559215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:12.559872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.560160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.560439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.629840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:12.655198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b440-cb34-467a-be91-e18422c2290a service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:12.664324 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:12.665623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:12.666057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:12.666446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:12.671129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:12.673620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:12.676175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:12.694151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1103/2205] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:12.769043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:12.770722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b162fa8-0fae-4120-b7b7-2f1936f51439 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:12.786659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1103/2206] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:54:16.495885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:16.516257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:16.629446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5f1d3-3811-441c-ae56-337ce1cf95e9 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:16.638692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:16.639729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:16.640159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:16.640578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] PATH_INFO: `/v3/users/fa53ebdc14c447f3b8aa624f4c1c3169` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:16.642170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa53ebdc14c447f3b8aa624f4c1c3169)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:16.644848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:16.743573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa53ebdc14c447f3b8aa624f4c1c3169'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:16.744868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa53ebdc14c447f3b8aa624f4c1c3169'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:16.746391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa53ebdc14c447f3b8aa624f4c1c3169'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:16.796140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa53ebdc14c447f3b8aa624f4c1c3169'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:16.815197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa53ebdc14c447f3b8aa624f4c1c3169'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:16.832090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1104/2207] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:16 2022] DELETE /identity/v3/users/fa53ebdc14c447f3b8aa624f4c1c3169 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:16.855304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e952-721a-408a-8371-260cd71130ad None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:16.855304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e952-721a-408a-8371-260cd71130ad None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:16.855304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47e952-721a-408a-8371-260cd71130ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:16.887461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bf47e952-721a-408a-8371-260cd71130ad None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:16.890175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf47e952-721a-408a-8371-260cd71130ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:16.995385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1104/2208] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:17.008968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:17.011965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:17.162360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68f08-c7dd-4238-b1da-73510242af95 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:17.169541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:17.171044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:17.171557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:17.172081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:17.211600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:17.215495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:17.235576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1105/2209] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:17.621832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47e952-721a-408a-8371-260cd71130ad None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:17.623611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf47e952-721a-408a-8371-260cd71130ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:17.643434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47e952-721a-408a-8371-260cd71130ad None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:17.653010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:17.654513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:17.654932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:17.655233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] PATH_INFO: `/v3/projects/1f4fe462f5784d61bbf6afd54ef262dc` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:17.657134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4fe462f5784d61bbf6afd54ef262dc)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:17.660339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:17.753709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4fe462f5784d61bbf6afd54ef262dc', 'request_id': 'req-639ebccb-e643-483d-995a-9c66873669f6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.764858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4fe462f5784d61bbf6afd54ef262dc', 'request_id': 'req-639ebccb-e643-483d-995a-9c66873669f6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.772670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4fe462f5784d61bbf6afd54ef262dc', 'request_id': 'req-639ebccb-e643-483d-995a-9c66873669f6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.786927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] The token cache is being invalidate because project 1f4fe462f5784d61bbf6afd54ef262dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:17.787289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.788024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.789634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1105/2210] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:17 2022] DELETE /identity/v3/projects/1f4fe462f5784d61bbf6afd54ef262dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:17.794583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:17.805890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0315b44-33ab-4998-9049-3d7b78cc4735 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:17.849907 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:17.892675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:17.893451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:17.893845 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:17.894282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] PATH_INFO: `/v3/users/6774eab1a15d4b1cbbcc4d258daad142` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:17.896331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6774eab1a15d4b1cbbcc4d258daad142)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:17.899923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:17.987036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6774eab1a15d4b1cbbcc4d258daad142'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.988135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6774eab1a15d4b1cbbcc4d258daad142'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:17.988976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6774eab1a15d4b1cbbcc4d258daad142'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:18.014595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6774eab1a15d4b1cbbcc4d258daad142'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:18.028089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6774eab1a15d4b1cbbcc4d258daad142'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:18.055848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1106/2211] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:17 2022] DELETE /identity/v3/users/6774eab1a15d4b1cbbcc4d258daad142 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:18.169561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:18.172048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:18.241653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:18.307064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ebccb-e643-483d-995a-9c66873669f6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:18.415713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:18.417367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:18.417872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:18.418347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:18.421954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:18.539531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:18.543335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:18.577836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1106/2212] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:18.804490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:18.806269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:18.906626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de38067-efbc-4149-bed0-137bf65c0496 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:18.912744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:18.913463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:18.913801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:18.914114 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] PATH_INFO: `/v3/projects/f739099f9d7444f1a85f1c9abeef5c71` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:18.915503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f739099f9d7444f1a85f1c9abeef5c71)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:18.918195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:19.110170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f739099f9d7444f1a85f1c9abeef5c71', 'request_id': 'req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.148828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f739099f9d7444f1a85f1c9abeef5c71', 'request_id': 'req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.159886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:19.185965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f739099f9d7444f1a85f1c9abeef5c71', 'request_id': 'req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.236126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] The token cache is being invalidate because project f739099f9d7444f1a85f1c9abeef5c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:19.236619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.237850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.240387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1107/2213] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:18 2022] DELETE /identity/v3/projects/f739099f9d7444f1a85f1c9abeef5c71 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:19.246321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:19.267039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d0f0-ede5-4beb-ac07-1a2c13054e94 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:19.437822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:19.438151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:19.438419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:19.438749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] PATH_INFO: `/v3/users/0a02cafa9e7849d18d00cba6ad0000d2` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:19.440624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a02cafa9e7849d18d00cba6ad0000d2)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:19.444465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:19.537500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:19.555342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a02cafa9e7849d18d00cba6ad0000d2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.556384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a02cafa9e7849d18d00cba6ad0000d2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.593150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a02cafa9e7849d18d00cba6ad0000d2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.594423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a02cafa9e7849d18d00cba6ad0000d2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.610610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-d1aef5dd-2e05-44ac-bf96-8c0942de44f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a02cafa9e7849d18d00cba6ad0000d2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:19.630970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1107/2214] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:19 2022] DELETE /identity/v3/users/0a02cafa9e7849d18d00cba6ad0000d2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:20.248005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:20.264407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:20.304270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18104-6d56-4dd4-b26b-6dfa90d929a9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:20.417404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:20.418390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:20.419032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:20.419519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] PATH_INFO: `/v3/projects/9bfa00c905c84fe08515b25876c68c8b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:20.420767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfa00c905c84fe08515b25876c68c8b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:20.423026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:20.515685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfa00c905c84fe08515b25876c68c8b', 'request_id': 'req-2daec98f-199b-4487-adac-67e8bf8c564d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:20.525621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfa00c905c84fe08515b25876c68c8b', 'request_id': 'req-2daec98f-199b-4487-adac-67e8bf8c564d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:20.534675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfa00c905c84fe08515b25876c68c8b', 'request_id': 'req-2daec98f-199b-4487-adac-67e8bf8c564d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:20.560954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] The token cache is being invalidate because project 9bfa00c905c84fe08515b25876c68c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:20.561606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:20.563160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2daec98f-199b-4487-adac-67e8bf8c564d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:20.574767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1108/2215] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:20 2022] DELETE /identity/v3/projects/9bfa00c905c84fe08515b25876c68c8b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:20.580272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:20.580758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:20.581187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:20.617381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:20.619564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:20.755571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1108/2216] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:20.773793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:20.774360 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:20.775309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:20.816631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:20.818894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:20.840071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1109/2217] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:20.842411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:20.860243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d0c9-3f30-4604-875c-71017806f8a4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:20.868144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:20.869161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:20.869725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:20.870282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:20.871568 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:20.872114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:20.875381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:20.898143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1109/2218] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:20.903627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:20.914496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c73cc-5893-41e8-afaf-656545c2a434 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:20.920101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:20.920771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:20.921059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:20.921342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:20.922037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:20.924319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:20.964779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1110/2219] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:20 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:20.970995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:20.986975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430856c-68d2-42e0-adf4-d44eca6568fa admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.077652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.078309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.078599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.078892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.079532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.081477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.106909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1110/2220] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:20 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:21.113335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.134897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c4-4f11-4cae-8979-7fe6364255d4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.143883 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.144832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.145275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.145683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.146695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.148831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.162499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1111/2221] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:21.168817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.187870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c12d5a-05af-488c-812b-82bf2ce1838f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.194279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.195620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.196350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.196832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.198561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.201821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b7612-a276-4c64-8e59-cc8fe7e51624 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.223530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1111/2222] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:21.230554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.246867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0ec5-7b3c-432c-954a-c03c6a5ec54c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.255872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.257363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.258161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.258806 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] PATH_INFO: `/v3/projects/29863ab8775648f894cf24fe47e1f376/users/58b85fa5f9614d2aaf01c8fd110558b1/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.285024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29863ab8775648f894cf24fe47e1f376, user_id=58b85fa5f9614d2aaf01c8fd110558b1, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.293007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.320854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1112/2223] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:21 2022] PUT /identity/v3/projects/29863ab8775648f894cf24fe47e1f376/users/58b85fa5f9614d2aaf01c8fd110558b1/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:21.338450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.339021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.339552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.386277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] MFA Rules not processed for user `58b85fa5f9614d2aaf01c8fd110558b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:21.387514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:21.398268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:21.543353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1112/2224] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:21.551123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.578372 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:21.669356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696058b-2f23-40bf-aa2b-028dc59420a4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.674659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.675403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.675780 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.676174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.676911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.679089 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.716076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1113/2225] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:21 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:21.721156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.741948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c46c9-c617-40fe-a899-cc140d24a7d8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.813215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.814089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.814556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.814718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.815291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.818508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.861649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1113/2226] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:21 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:21.866950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.882743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b1cf-8dd7-4e30-b459-e129d4e4f8dc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.888940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.889581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.889904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.890220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.890890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.892800 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.908503 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1114/2227] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:21.913325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:21.926964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422679-8714-4c55-b756-be703d4119e8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:21.932382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:21.933005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:21.933341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:21.933623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] PATH_INFO: `/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d/users/1d3a2aeb8da44000aaf7066a0011f05a/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:21.955750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e866cc30d4bd6b89ea3a3718ce55d, user_id=1d3a2aeb8da44000aaf7066a0011f05a, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:21.958547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:21.983090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1114/2228] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:21 2022] PUT /identity/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d/users/1d3a2aeb8da44000aaf7066a0011f05a/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:21.988853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:22.007232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02254853-17fd-4f17-85c9-460ef55149d5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:22.109844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:22.110555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:22.110936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:22.111352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:22.112140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:22.113758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344e821-f266-48b6-a8ce-b060ddbfbbd1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:22.128613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1115/2229] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:54:22.134917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:22.154915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc4b1-68b5-46c0-8046-c7cea4b3033e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:22.160624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:22.161305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:22.161594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:22.161902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] PATH_INFO: `/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d/users/1d3a2aeb8da44000aaf7066a0011f05a/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:22.164164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e866cc30d4bd6b89ea3a3718ce55d, user_id=1d3a2aeb8da44000aaf7066a0011f05a, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:22.167385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:22.181006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1115/2230] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:22 2022] PUT /identity/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d/users/1d3a2aeb8da44000aaf7066a0011f05a/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:22.193989 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:22.194296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:22.194624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:22.235045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] MFA Rules not processed for user `1d3a2aeb8da44000aaf7066a0011f05a`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:22.237202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:22.350269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1116/2231] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:22.368556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:22.371874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:22.466554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c347a-a38c-4647-9637-03d51367ed91 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:22.471095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:22.471862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:22.472278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:22.472661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:22.484413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:22.486144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:22.499226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1116/2232] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:22.640023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:22.642680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:22.667369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea135ec-1cb0-4b13-a76a-76d6baf4ee56 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:22.674171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:22.675240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:22.675739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:22.676232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:22.684217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:22.771908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:22.773582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3b9a7-a785-4542-9ab0-8efd44f31289 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:22.785250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1117/2233] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:23.208296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:23.217313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:23.345311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76c5c0-d014-450e-9a82-c198556741ed service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:23.356135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:23.357177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:23.358280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:23.358733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] PATH_INFO: `/v3/users/58b85fa5f9614d2aaf01c8fd110558b1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:23.360833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b85fa5f9614d2aaf01c8fd110558b1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:23.364556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:23.438282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b85fa5f9614d2aaf01c8fd110558b1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:23.439553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b85fa5f9614d2aaf01c8fd110558b1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:23.459750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b85fa5f9614d2aaf01c8fd110558b1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:23.461516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b85fa5f9614d2aaf01c8fd110558b1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:23.483529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b85fa5f9614d2aaf01c8fd110558b1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:23.518789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1117/2234] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:23 2022] DELETE /identity/v3/users/58b85fa5f9614d2aaf01c8fd110558b1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:23.526265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:23.528941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:23.529443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:23.562064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:23.563552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:23.695133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1118/2235] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:23.709599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:23.715821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:23.835575 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e31-2ee0-4958-8445-1405355d2aea admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:23.843450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:23.844217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:23.844473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:23.844760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:23.868080 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:23.871670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:23.895036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1118/2236] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:24.412783 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:24.414658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:24.431206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d4ad0-046e-4020-aac7-c5748eb37890 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:24.438794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:24.439516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:24.440197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:24.440197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:24.440546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] PATH_INFO: `/v3/projects/29863ab8775648f894cf24fe47e1f376` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:24.441884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29863ab8775648f894cf24fe47e1f376)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:24.443900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:24.447170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:24.480012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7769c-78c3-4fbb-802e-a022aa1c773d service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:24.490176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:24.491028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:24.491443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:24.491697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] PATH_INFO: `/v3/users/b8bd0aa0586447689148a35c9865f893` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:24.493124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bd0aa0586447689148a35c9865f893)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:24.495548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:24.527640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:24.534143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29863ab8775648f894cf24fe47e1f376', 'request_id': 'req-e8e693ef-0599-4a2f-a877-f53107e93061'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.565391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29863ab8775648f894cf24fe47e1f376', 'request_id': 'req-e8e693ef-0599-4a2f-a877-f53107e93061'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.590227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29863ab8775648f894cf24fe47e1f376', 'request_id': 'req-e8e693ef-0599-4a2f-a877-f53107e93061'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.604835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bd0aa0586447689148a35c9865f893'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.606010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bd0aa0586447689148a35c9865f893'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.633083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] The token cache is being invalidate because project 29863ab8775648f894cf24fe47e1f376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:24.633988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.635453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.637578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1119/2237] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:24 2022] DELETE /identity/v3/projects/29863ab8775648f894cf24fe47e1f376 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:24.643697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:24.646482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bd0aa0586447689148a35c9865f893'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.647338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bd0aa0586447689148a35c9865f893'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.650040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:24.667472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-3117b69e-25d1-44ff-b35c-ed626a9e34be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bd0aa0586447689148a35c9865f893'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:24.701143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1119/2238] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:24 2022] DELETE /identity/v3/users/b8bd0aa0586447689148a35c9865f893 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:24.710756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:24.711227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:24.711698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:24.725964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:24.812957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:24.815997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:24.831519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e693ef-0599-4a2f-a877-f53107e93061 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:24.930367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1120/2239] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:24.944237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:24.945642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:24.956690 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:24.958369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:24.959155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:24.959896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] PATH_INFO: `/v3/users/1d3a2aeb8da44000aaf7066a0011f05a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:24.962432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3a2aeb8da44000aaf7066a0011f05a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:24.966626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:25.050873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88fd02-8c93-4bc2-a234-f8d8b632fbcf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:25.053588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3a2aeb8da44000aaf7066a0011f05a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.054713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3a2aeb8da44000aaf7066a0011f05a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.055531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3a2aeb8da44000aaf7066a0011f05a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.055722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:25.056764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:25.057578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:25.058047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:25.060340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:25.076016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:25.076459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3a2aeb8da44000aaf7066a0011f05a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.078113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:25.088475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3a2aeb8da44000aaf7066a0011f05a'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.092783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1121/2240] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:54:25.113154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1120/2241] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:24 2022] DELETE /identity/v3/users/1d3a2aeb8da44000aaf7066a0011f05a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:25.631108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:25.633986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:25.682357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea01c-1fee-4a8d-ab5f-525e1901e1e4 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:25.715824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:25.719090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:25.812027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:25.861578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:25.862808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:25.863387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:25.863852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] PATH_INFO: `/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:25.865606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4e866cc30d4bd6b89ea3a3718ce55d)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:25.868910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:25.888331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:25.902589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d2d3-0be7-440a-82d9-dbb28227057d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:25.910194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:25.911189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:25.911474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:25.911749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] PATH_INFO: `/v3/projects/d2ee866f2c3e41a89dca20388114fcf4` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:25.913224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ee866f2c3e41a89dca20388114fcf4)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:25.915255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:25.962653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4e866cc30d4bd6b89ea3a3718ce55d', 'request_id': 'req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.974323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4e866cc30d4bd6b89ea3a3718ce55d', 'request_id': 'req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.979619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ee866f2c3e41a89dca20388114fcf4', 'request_id': 'req-74105abb-53cc-4104-bcc4-a5fcf0053af9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.982864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4e866cc30d4bd6b89ea3a3718ce55d', 'request_id': 'req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.988724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ee866f2c3e41a89dca20388114fcf4', 'request_id': 'req-74105abb-53cc-4104-bcc4-a5fcf0053af9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.996792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] The token cache is being invalidate because project 4d4e866cc30d4bd6b89ea3a3718ce55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:25.997224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.998125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ce48aa2e-2d4f-44fe-9c33-d5cb89683027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:25.998606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ee866f2c3e41a89dca20388114fcf4', 'request_id': 'req-74105abb-53cc-4104-bcc4-a5fcf0053af9'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.000984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1122/2242] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:25 2022] DELETE /identity/v3/projects/4d4e866cc30d4bd6b89ea3a3718ce55d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:26.008998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b41c-15f4-4c71-b643-24a4eabedf34 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.009466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b41c-15f4-4c71-b643-24a4eabedf34 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.010438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b41c-15f4-4c71-b643-24a4eabedf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.023769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] The token cache is being invalidate because project d2ee866f2c3e41a89dca20388114fcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:26.024146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.025152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.034016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1121/2243] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:25 2022] DELETE /identity/v3/projects/d2ee866f2c3e41a89dca20388114fcf4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:26.034016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.035811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.044226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-22f7b41c-15f4-4c71-b643-24a4eabedf34 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:26.046257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-22f7b41c-15f4-4c71-b643-24a4eabedf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.136861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1123/2244] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:26.146015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74105abb-53cc-4104-bcc4-a5fcf0053af9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.151311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444d41-70be-481c-9a51-e894a11262dd None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.151773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444d41-70be-481c-9a51-e894a11262dd None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.152329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444d41-70be-481c-9a51-e894a11262dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.155905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.156915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.157385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.158039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] PATH_INFO: `/v3/users/de6d0e5077c142a6b76ff248ab293f8b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.159578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6d0e5077c142a6b76ff248ab293f8b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.161912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.186956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-73444d41-70be-481c-9a51-e894a11262dd None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:26.188407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-73444d41-70be-481c-9a51-e894a11262dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.198202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1124/2245] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:26.202822 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444d41-70be-481c-9a51-e894a11262dd None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.214331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444d41-70be-481c-9a51-e894a11262dd None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.220011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.220734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.221028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.221291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.222047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:26.222384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.224395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.238357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6d0e5077c142a6b76ff248ab293f8b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.239158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6d0e5077c142a6b76ff248ab293f8b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.240132 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6d0e5077c142a6b76ff248ab293f8b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.241425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1125/2246] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:54:26.247452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.252240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.260231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6d0e5077c142a6b76ff248ab293f8b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.279526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6d0e5077c142a6b76ff248ab293f8b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.279994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a2d86-eb91-47ab-adda-9e7c462e89ef admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.287704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.288985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.289715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.289958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.291692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.294417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.294768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1122/2247] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:26 2022] DELETE /identity/v3/users/de6d0e5077c142a6b76ff248ab293f8b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:26.339364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1126/2248] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:26 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:26.344124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.356309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:26.445315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c842-da61-49f4-9469-cca02d8dd68f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.550668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.552444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.552444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.552987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.554332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.559216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.608448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1123/2249] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:26 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:26.611360 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.630726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f29d-b2ec-4969-977e-1b4c91ed3d09 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.639701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.640830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.641237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.641605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.642412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.644534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.661830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1127/2250] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:26.671799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.692982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc5a10-bd99-41c7-aeaa-35c8466c5ff0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.703462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.704344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.704836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.705891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.706493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.707486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.707857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.709947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.727530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1124/2251] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:26.733804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:26.764197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8964c6-d8c5-4e8a-b8de-28afe05a3f68 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.781585 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.782766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.783453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.784175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] PATH_INFO: `/v3/projects/14b4e6d4e43e442191d263e708dedc40/users/78ce3e3afc6049ad8ec7947f08f3217e/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.788321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b146d-a1ff-4b98-ba64-e3fcaebac7c4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:26.810771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b4e6d4e43e442191d263e708dedc40, user_id=78ce3e3afc6049ad8ec7947f08f3217e, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.814319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ea949-54ae-4c9d-9c6b-b3bc0e11e1e4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.819896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:26.823260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.823552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.827148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] PATH_INFO: `/v3/projects/0d8663d8e3824b87afe484d687ec46e5` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.830688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8663d8e3824b87afe484d687ec46e5)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:26.832991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:26.842761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1125/2252] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:26 2022] PUT /identity/v3/projects/14b4e6d4e43e442191d263e708dedc40/users/78ce3e3afc6049ad8ec7947f08f3217e/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:26.847278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af835-a9ba-4a73-82df-9d9d03068e26 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:26.848066 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af835-a9ba-4a73-82df-9d9d03068e26 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:26.848361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af835-a9ba-4a73-82df-9d9d03068e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:26.872550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:26.884551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1a2af835-a9ba-4a73-82df-9d9d03068e26 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:26.890002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1a2af835-a9ba-4a73-82df-9d9d03068e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:26.953321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8663d8e3824b87afe484d687ec46e5', 'request_id': 'req-958282a1-518d-4d5d-ae4e-83cbdf513e4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.983321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8663d8e3824b87afe484d687ec46e5', 'request_id': 'req-958282a1-518d-4d5d-ae4e-83cbdf513e4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:26.997240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8663d8e3824b87afe484d687ec46e5', 'request_id': 'req-958282a1-518d-4d5d-ae4e-83cbdf513e4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:27.015539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] The token cache is being invalidate because project 0d8663d8e3824b87afe484d687ec46e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:27.016050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:27.017094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:27.019648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1128/2253] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:26 2022] DELETE /identity/v3/projects/0d8663d8e3824b87afe484d687ec46e5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:27.020857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1126/2254] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:27.036512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:27.039393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:27.176547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958282a1-518d-4d5d-ae4e-83cbdf513e4d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:27.180725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:27.181597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:27.182242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:27.182242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:27.184112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:27.277010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:27.279036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:27.290612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1129/2255] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:28.113441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.114304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.114304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.132776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:28.154457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] MFA Rules not processed for user `78ce3e3afc6049ad8ec7947f08f3217e`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:28.167852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:28.283844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1127/2256] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:28.288688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.290443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:28.304622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097944-6e9d-4a4c-9b8a-c6c028b1df8f service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.310891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.312382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.312382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.312382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.312821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.314812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.355573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1130/2257] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:28 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:28.360182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.378637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058cba9-e04b-46d8-99ac-af780de9e8ce None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.466870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.467737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.468155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.468720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.470730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.473945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.499480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1128/2258] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:28 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:28.504593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.521503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5a9-7796-4158-a984-37885df6b043 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.528690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.529355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.529655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.529959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.530630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.532373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.545713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1131/2259] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:28.550234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.562573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7ec9-2ce3-4591-afdb-c0c63d8d5801 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.569547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.570350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.570961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.571545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] PATH_INFO: `/v3/projects/f34982349d084c2dbd92e469b38291ce/users/d33a0a1fed254cafb825b12429b3ceb6/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.594398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34982349d084c2dbd92e469b38291ce, user_id=d33a0a1fed254cafb825b12429b3ceb6, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.597172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.614489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1129/2260] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:28 2022] PUT /identity/v3/projects/f34982349d084c2dbd92e469b38291ce/users/d33a0a1fed254cafb825b12429b3ceb6/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:28.620982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.632053 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618721b-bfba-4214-89f4-9fa6d5d36790 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.657506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:28.715881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.716511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.716796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.717074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.717731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.719483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c40d55-23af-45a2-ac87-3f39e81bef7e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.736290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1132/2261] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:28.740916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:28.752095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2dd92-296f-4bc4-b72e-488a4e33c1fd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:28.757103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:28.757802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:28.758081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:28.758472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] PATH_INFO: `/v3/projects/f34982349d084c2dbd92e469b38291ce/users/d33a0a1fed254cafb825b12429b3ceb6/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:28.760378 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34982349d084c2dbd92e469b38291ce, user_id=d33a0a1fed254cafb825b12429b3ceb6, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:28.763201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efc1c-d5ad-44fe-83fc-fcd9bb6ac901 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:28.777068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1130/2262] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:28 2022] PUT /identity/v3/projects/f34982349d084c2dbd92e469b38291ce/users/d33a0a1fed254cafb825b12429b3ceb6/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:29.718870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:29.719471 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:29.720133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:29.778709 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] MFA Rules not processed for user `d33a0a1fed254cafb825b12429b3ceb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:29.779942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:29.874918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1133/2263] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:29.886502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca424-8e86-4146-bfc5-a8d0effbd28d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:29.887271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca424-8e86-4146-bfc5-a8d0effbd28d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:29.887404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca424-8e86-4146-bfc5-a8d0effbd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:29.911437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-fc4ca424-8e86-4146-bfc5-a8d0effbd28d None None] MFA Rules not processed for user `78ce3e3afc6049ad8ec7947f08f3217e`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:29.912797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fc4ca424-8e86-4146-bfc5-a8d0effbd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:29.994263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:30.015901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1131/2264] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:30.043594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:30.045969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:30.161937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e24c-0657-4e58-819a-20eb0f351a13 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:30.172132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:30.172892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:30.173180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:30.173457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:30.188370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:30.190082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:30.201888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1134/2265] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:34.488193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d95a-2e2d-4881-8b5c-4ccdef0dfb68 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:34.489577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d95a-2e2d-4881-8b5c-4ccdef0dfb68 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:34.491186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d95a-2e2d-4881-8b5c-4ccdef0dfb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:34.521704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0517d95a-2e2d-4881-8b5c-4ccdef0dfb68 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:34.524161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0517d95a-2e2d-4881-8b5c-4ccdef0dfb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:34.617531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1132/2266] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:54:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:34.682679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:34.684175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:34.725101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:34.788696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b6c59-11c6-4d82-9adc-555521e957bc service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:34.797513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:34.798468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:34.798982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:34.799466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:34.822580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:34.824266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:34.833662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1135/2267] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:35.652827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e592dd-1a12-46f0-b5fd-0cc6c831401b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:35.653479 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e592dd-1a12-46f0-b5fd-0cc6c831401b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:35.653881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e592dd-1a12-46f0-b5fd-0cc6c831401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:35.685323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f0e592dd-1a12-46f0-b5fd-0cc6c831401b None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:35.687242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f0e592dd-1a12-46f0-b5fd-0cc6c831401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:35.696311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1133/2268] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 05:54:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:35.736469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:35.762127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498122-3493-4b17-9572-45cfaf7a58fa service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:35.796573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:35.798029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:35.798482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:35.803910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:35.823888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:35.830497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:35.854767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1136/2269] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:36.209277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da6a4-869b-4851-bb3a-bdb467128339 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:36.210137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da6a4-869b-4851-bb3a-bdb467128339 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:36.210613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da6a4-869b-4851-bb3a-bdb467128339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:36.238620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-359da6a4-869b-4851-bb3a-bdb467128339 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:36.240254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-359da6a4-869b-4851-bb3a-bdb467128339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:36.250225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1134/2270] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:36.266067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:36.278984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133381db-f17c-43ca-a87e-f06f2f6f2dea service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:36.291845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:36.292491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:36.292813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:36.292813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:36.307034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:36.308853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:36.318658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1137/2271] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:54:36.802527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:36.803097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:36.803328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:36.829724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:36.831125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:36.839623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1135/2272] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:36.857697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:36.876142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21ac2-0597-4734-b40b-2e3eef3c313c service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:36.886228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:36.887566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:36.888351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:36.889065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:36.906314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:36.909448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ddfaa-4580-42bc-8d43-b55f7132e719 service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:36.934812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1138/2273] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:39.548542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:39.558178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:39.776027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673190-a7c9-46c6-9622-0bdbf8562535 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:39.785325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:39.786468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:39.786952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:39.787650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] PATH_INFO: `/v3/users/495c47d01448481ab7a08a566fd46783` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:39.790028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495c47d01448481ab7a08a566fd46783)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:39.793116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:39.880319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495c47d01448481ab7a08a566fd46783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:39.881731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495c47d01448481ab7a08a566fd46783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:39.882695 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495c47d01448481ab7a08a566fd46783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:39.911040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495c47d01448481ab7a08a566fd46783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:39.923811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495c47d01448481ab7a08a566fd46783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:39.948533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:39.961141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1136/2274] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:39 2022] DELETE /identity/v3/users/495c47d01448481ab7a08a566fd46783 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:39.965842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:39.967007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:39.967007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:40.000229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:40.001750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:40.115612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1139/2275] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:40.129887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:40.131484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:40.245312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e429e1-7e3f-4151-8fd3-2785f88ad4c7 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:40.253468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:40.254804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:40.255762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:40.256444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:40.270352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:40.271944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efad7e5-e68a-4de3-863d-cd5446302c64 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:40.283240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1137/2276] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:54:40.526653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:40.529182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:40.581226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937136-93a9-4c83-a194-d42eab2a633b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:40.590600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:40.592015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:40.592305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:40.592573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] PATH_INFO: `/v3/projects/478ca9888b1f47098da79fcf15c0904a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:40.594509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478ca9888b1f47098da79fcf15c0904a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:40.597465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:40.676638 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478ca9888b1f47098da79fcf15c0904a', 'request_id': 'req-c1d6a164-529f-4061-8337-e71416a11d09'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:40.700403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478ca9888b1f47098da79fcf15c0904a', 'request_id': 'req-c1d6a164-529f-4061-8337-e71416a11d09'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:40.713866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478ca9888b1f47098da79fcf15c0904a', 'request_id': 'req-c1d6a164-529f-4061-8337-e71416a11d09'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:40.726369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:40.734678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] The token cache is being invalidate because project 478ca9888b1f47098da79fcf15c0904a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:40.735289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:40.736527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c1d6a164-529f-4061-8337-e71416a11d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:40.741860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1140/2277] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:40 2022] DELETE /identity/v3/projects/478ca9888b1f47098da79fcf15c0904a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:40.747807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:40.748630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:40.748630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:40.779037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:40.781340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:40.915701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1138/2278] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:40.936633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:40.937129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:40.937611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:40.980016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:40.981235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:40.993929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1141/2279] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:40.999953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.018297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0400-5f54-4aeb-85d5-ad083c000563 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.028085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.029299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.029722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.030047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.031170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:41.031706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.034407 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.053827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1139/2280] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:54:41.060999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.080903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c4642-2cf0-45e8-8916-66d7dfefba35 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.089408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.090477 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.090969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.091433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.092692 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.095068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.130447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1142/2281] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:41 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:41.136289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.155126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767ddd7-df51-43e4-bca1-7a29931df7e8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.260060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.260865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.261374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.261869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.262955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.266472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.299711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1140/2282] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:41 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:41.306448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.321403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6eaf-e024-41aa-92d0-62ebf8c98cad admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.327308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.327940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.328225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.328504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.329299 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.330944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.342397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1143/2283] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:41.348274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.359840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290de7-0685-44f0-b949-1e6bea4c1eba admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.364790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.365415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.365702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.366008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.366668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.368282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179480-b0ec-4c73-93bd-8a14906cbaac admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.380606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1141/2284] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:41.387178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.401321 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9f0-6c19-4b98-916b-2ed99a79eed4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.406259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.406925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.407208 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.407485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] PATH_INFO: `/v3/projects/8096d58f3598419291842e24b0e9daed/users/ef4f4ca36fd044cc8835ac50a2696023/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.425660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8096d58f3598419291842e24b0e9daed, user_id=ef4f4ca36fd044cc8835ac50a2696023, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.428389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.447970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1144/2285] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:41 2022] PUT /identity/v3/projects/8096d58f3598419291842e24b0e9daed/users/ef4f4ca36fd044cc8835ac50a2696023/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:41.453098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222d202-b424-4901-baf3-73bfa5712206 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.453392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222d202-b424-4901-baf3-73bfa5712206 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.453673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222d202-b424-4901-baf3-73bfa5712206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.468019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:41.475422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7222d202-b424-4901-baf3-73bfa5712206 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:41.477312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7222d202-b424-4901-baf3-73bfa5712206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:41.544536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1142/2286] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:41.559364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:41.561328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:41.631247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc22a-094e-4344-bb97-725af259427b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:41.637723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:41.638807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:41.639311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:41.639813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:41.651858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:41.654387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:41.670480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1145/2287] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:42.894234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48210d-0084-4924-8b0d-f394e92c49a0 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:42.894965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48210d-0084-4924-8b0d-f394e92c49a0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:42.895342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48210d-0084-4924-8b0d-f394e92c49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:42.952892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5f48210d-0084-4924-8b0d-f394e92c49a0 None None] MFA Rules not processed for user `ef4f4ca36fd044cc8835ac50a2696023`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:42.955396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5f48210d-0084-4924-8b0d-f394e92c49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:43.072478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1143/2288] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:43.086617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:43.089191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:43.199487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c38011-eeca-4e74-b804-985469b94ed3 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:43.206178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:43.207357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:43.208002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:43.208408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:43.225213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:43.228916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:43.250569 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1146/2289] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:45.013875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff3d9-47ae-4704-b360-456c45ab506e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:45.014512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff3d9-47ae-4704-b360-456c45ab506e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:45.014512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff3d9-47ae-4704-b360-456c45ab506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:45.054147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-547ff3d9-47ae-4704-b360-456c45ab506e None None] MFA Rules not processed for user `ef4f4ca36fd044cc8835ac50a2696023`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:45.055389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-547ff3d9-47ae-4704-b360-456c45ab506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:45.064148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1144/2290] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:45.479052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:45.480683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:45.516674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5c20c-ca5b-439b-8083-0637820d692a service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:45.524340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:45.526016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:45.527469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:45.527979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] PATH_INFO: `/v3/users/bf86b96abad74f79b06539de2d08e67d` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:45.530708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf86b96abad74f79b06539de2d08e67d)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:45.534280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:45.630093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:45.648565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf86b96abad74f79b06539de2d08e67d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:45.651605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf86b96abad74f79b06539de2d08e67d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:45.676462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf86b96abad74f79b06539de2d08e67d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:45.678232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf86b96abad74f79b06539de2d08e67d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:45.692408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf86b96abad74f79b06539de2d08e67d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:45.725418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1147/2291] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:45 2022] DELETE /identity/v3/users/bf86b96abad74f79b06539de2d08e67d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:45.727229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:45.727542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:45.727834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:45.761389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:45.763930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:45.877180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1145/2292] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:45.882330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:45.884941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:45.988024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a45ce-1004-4dc1-b45c-05a0231d5b65 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:45.992428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:46.005239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:46.005576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:46.005913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:46.035256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:46.041506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6707e-b98f-41f5-9e28-3feaada872b6 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:46.063004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1148/2293] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:46.704572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:46.707141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:46.732986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73881ecb-fbd4-4ab9-be64-73197c594edf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:46.762334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:46.763363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:46.763794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:46.764279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] PATH_INFO: `/v3/projects/1e561d58774b411d8d7880a29f09fe2f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:46.769920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e561d58774b411d8d7880a29f09fe2f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:46.779385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:46.860699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:46.921003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e561d58774b411d8d7880a29f09fe2f', 'request_id': 'req-52defe86-8b5d-4137-8546-84153bdd7fed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:46.955491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e561d58774b411d8d7880a29f09fe2f', 'request_id': 'req-52defe86-8b5d-4137-8546-84153bdd7fed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:46.974421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e561d58774b411d8d7880a29f09fe2f', 'request_id': 'req-52defe86-8b5d-4137-8546-84153bdd7fed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:47.006159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] The token cache is being invalidate because project 1e561d58774b411d8d7880a29f09fe2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:47.006825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:47.009031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-52defe86-8b5d-4137-8546-84153bdd7fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:47.013282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1146/2294] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:46 2022] DELETE /identity/v3/projects/1e561d58774b411d8d7880a29f09fe2f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:47.020455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.022280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.022876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.057127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:47.058777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:47.198344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.198856 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.199373 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.208384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1149/2295] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:47.238694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:47.252037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:47.293532 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1147/2296] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:47.296311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.329453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb232ad-2541-4709-8b6f-f83f0d7ed53d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.353836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.354178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.355095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.356540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.358464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:47.362951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.366706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.417098 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1150/2297] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:47.427389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.448351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5dc3-9956-44a2-b87d-d87064517777 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.470573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.474150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.475668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.476147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.479244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.482820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.521824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1148/2298] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:47 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:47.526990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.541437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6c052-9c4a-492f-b12c-65bb5e0d3715 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.611260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:47.637930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.638933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.639417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.639928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.641146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.644827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.682457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1151/2299] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:47 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:47.690031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.704853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c55e-d90d-4a68-a202-231e484a4f03 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.710870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.711921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.712894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.713333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.714587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.717475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.733605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1149/2300] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:47.740345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.760465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e0c-6a09-4f6e-889b-6d3686cd4ce8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.771175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.772648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.773123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.773814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.775261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.779206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1936f-36ee-483d-b162-653fff508ef5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.805255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1152/2301] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:47.813357 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:47.831751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac086-a1c5-4b6f-89a2-3cb1c532713c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:47.839876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:47.840587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.841050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.841582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] PATH_INFO: `/v3/projects/bc42b570c4614a3b89bdebfc15692847/users/abb9abd2846f4a6baff40ffc567e3a05/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.887193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc42b570c4614a3b89bdebfc15692847, user_id=abb9abd2846f4a6baff40ffc567e3a05, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:47.892217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:47.918017 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1150/2302] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:47 2022] PUT /identity/v3/projects/bc42b570c4614a3b89bdebfc15692847/users/abb9abd2846f4a6baff40ffc567e3a05/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:47.937099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:47.937371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:47.937658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:47.980911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] MFA Rules not processed for user `abb9abd2846f4a6baff40ffc567e3a05`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:47.982369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:48.064757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1153/2303] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:48.079820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:48.081651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:48.166527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65dd9d-f5dd-4ab8-9bb8-cf5dba9d6ef3 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:48.171240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:48.172080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:48.172519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:48.172673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:48.190593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:48.193080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:48.209641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1151/2304] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:51.397888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:51.412422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60a515-6bc2-4b95-a7f4-5465ead422b4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:51.417540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:51.418612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:51.419112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:51.419599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:51.422911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:51.543940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:51.545981 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794634e-b92d-49ae-9064-3fa025f3cdf6 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:51.563640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1154/2305] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:53.608993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:53.610639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:53.673685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:53.690457 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef646a38-4475-4e2e-8255-715abda32d5c service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:53.696628 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:53.697280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:53.697599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:53.697911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] PATH_INFO: `/v3/users/84382431af084e569e482e89272b2a48` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:53.699178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84382431af084e569e482e89272b2a48)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:53.701272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:53.759874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84382431af084e569e482e89272b2a48'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:53.760606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84382431af084e569e482e89272b2a48'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:53.761303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84382431af084e569e482e89272b2a48'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:53.775418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84382431af084e569e482e89272b2a48'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:53.784759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84382431af084e569e482e89272b2a48'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:53.798590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1152/2306] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:53 2022] DELETE /identity/v3/users/84382431af084e569e482e89272b2a48 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:53.804444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:53.805160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:53.805464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:53.827204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:53.828330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:53.874613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:53.897641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1155/2307] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:53.920534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:53.922841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:53.995509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:53.996947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.005148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aaed8-a4c6-4653-b920-4a544b39caa6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.010427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.011060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.011188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573beb5b-4c20-441f-8139-c7bc226ac214 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.011420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.011611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.017328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.018597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.019062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.019763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] PATH_INFO: `/v3/users/abb9abd2846f4a6baff40ffc567e3a05` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.022683 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb9abd2846f4a6baff40ffc567e3a05)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.026250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.026676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.027504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13289d8d-c801-43b5-83d7-562cd0cd00ad service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.050817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1153/2308] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:54:54.116382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb9abd2846f4a6baff40ffc567e3a05'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.118343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb9abd2846f4a6baff40ffc567e3a05'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.136802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb9abd2846f4a6baff40ffc567e3a05'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.140433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb9abd2846f4a6baff40ffc567e3a05'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.156136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb9abd2846f4a6baff40ffc567e3a05'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.191732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1156/2309] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:53 2022] DELETE /identity/v3/users/abb9abd2846f4a6baff40ffc567e3a05 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:54.192866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.193231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.193720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.228036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:54.230277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.334074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1154/2310] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:54.344289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:54.346956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.440558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875023-b3ce-4075-a443-9b3e3affc711 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.446636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.447276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.447556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.447833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.458893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.460615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.477507 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1157/2311] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:54.755243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:54.759969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.779249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d6c92-e22b-42f6-84db-4ba1e478a466 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.789962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.791484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.792692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.793239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] PATH_INFO: `/v3/projects/d76e68c5833b478ab484067fa79d74ed` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.795336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76e68c5833b478ab484067fa79d74ed)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.798319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.815536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:54.901471 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76e68c5833b478ab484067fa79d74ed', 'request_id': 'req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.912779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76e68c5833b478ab484067fa79d74ed', 'request_id': 'req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.923312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76e68c5833b478ab484067fa79d74ed', 'request_id': 'req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.958816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] The token cache is being invalidate because project d76e68c5833b478ab484067fa79d74ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:54.959240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.959918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dd8a0bea-6cd5-4c61-a817-10ae7c3d57bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.964273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1155/2312] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:54 2022] DELETE /identity/v3/projects/d76e68c5833b478ab484067fa79d74ed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:55.570396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.572533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:55.600573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16ab3-0150-49bc-a044-220a8a051d68 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.753467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.754518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.754880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.755287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] PATH_INFO: `/v3/projects/bc42b570c4614a3b89bdebfc15692847` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.756875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc42b570c4614a3b89bdebfc15692847)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.759036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.762633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:55.875793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc42b570c4614a3b89bdebfc15692847', 'request_id': 'req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:55.906167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc42b570c4614a3b89bdebfc15692847', 'request_id': 'req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:55.941245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc42b570c4614a3b89bdebfc15692847', 'request_id': 'req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:55.961014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] The token cache is being invalidate because project bc42b570c4614a3b89bdebfc15692847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:55.963319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:55.964776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c93ceaf1-7405-45c2-9e78-9f95c8b6dfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:55.967600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1158/2313] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:55 2022] DELETE /identity/v3/projects/bc42b570c4614a3b89bdebfc15692847 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:57.922212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345755-bef8-4392-a289-8b4ff198d8d4 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.922778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345755-bef8-4392-a289-8b4ff198d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.923117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345755-bef8-4392-a289-8b4ff198d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.955091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-06345755-bef8-4392-a289-8b4ff198d8d4 None None] MFA Rules not processed for user `74a53d36cb7549479e0d4692ffde1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:57.957073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-06345755-bef8-4392-a289-8b4ff198d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:58.069447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1156/2314] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:05.954501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:06.647159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:06.648251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:06.648251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:06.687184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] MFA Rules not processed for user `4c62008668ca423dab42c576bb735b70`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:06.690878 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:06.813813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1159/2315] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:08.057268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:08.613939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:08.613939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:08.617106 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:08.653881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:08.656406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:08.822239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1157/2316] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:55:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:08.841673 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:08.849866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:09.026515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845b7a4-e3f5-4a3f-b045-8df348b74ebf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:09.035837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:09.036897 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:09.037399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:09.037937 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:09.055809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:09.057844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:09.071456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1160/2317] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:55:18.659540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.662059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:18.990826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350347e-bbb0-4132-9f3c-03b4193fa089 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:19.022549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:19.024222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:19.025003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:19.025804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] PATH_INFO: `/v3/users/78ce3e3afc6049ad8ec7947f08f3217e` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:19.028175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ce3e3afc6049ad8ec7947f08f3217e)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:19.033350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:19.065742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=57 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:19.142941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ce3e3afc6049ad8ec7947f08f3217e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:19.144062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ce3e3afc6049ad8ec7947f08f3217e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:19.145234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ce3e3afc6049ad8ec7947f08f3217e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:19.172055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ce3e3afc6049ad8ec7947f08f3217e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:19.192720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ce3e3afc6049ad8ec7947f08f3217e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:19.228960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1158/2318] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:18 2022] DELETE /identity/v3/users/78ce3e3afc6049ad8ec7947f08f3217e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:19.754043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:19.810633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5809b-d6bd-4b1c-983c-d8954b06094c service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:19.933690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:19.934748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:19.935275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:19.935793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] PATH_INFO: `/v3/projects/14b4e6d4e43e442191d263e708dedc40` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:19.937207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b4e6d4e43e442191d263e708dedc40)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:19.939844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:20.020147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b4e6d4e43e442191d263e708dedc40', 'request_id': 'req-59751f62-c90a-45ac-8058-139fee34d59e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.037257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b4e6d4e43e442191d263e708dedc40', 'request_id': 'req-59751f62-c90a-45ac-8058-139fee34d59e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.056583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b4e6d4e43e442191d263e708dedc40', 'request_id': 'req-59751f62-c90a-45ac-8058-139fee34d59e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.085622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] The token cache is being invalidate because project 14b4e6d4e43e442191d263e708dedc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:20.086887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.087844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.094258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1161/2319] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:19 2022] DELETE /identity/v3/projects/14b4e6d4e43e442191d263e708dedc40 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:20.094813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:20.097109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:20.144558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6355b3-55ec-4595-a598-8a14fff220d4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:20.216874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:20.462092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:20.462092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:20.462092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:20.462859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] PATH_INFO: `/v3/users/d33a0a1fed254cafb825b12429b3ceb6` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:20.472661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33a0a1fed254cafb825b12429b3ceb6)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:20.472661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:20.645346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33a0a1fed254cafb825b12429b3ceb6'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.646309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33a0a1fed254cafb825b12429b3ceb6'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.647193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33a0a1fed254cafb825b12429b3ceb6'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.670499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33a0a1fed254cafb825b12429b3ceb6'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.687846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f07cf338-4bd9-4ba3-b3f7-484a6988fe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33a0a1fed254cafb825b12429b3ceb6'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.742448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1159/2320] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:20 2022] DELETE /identity/v3/users/d33a0a1fed254cafb825b12429b3ceb6 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:21.007903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.009572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.034547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59751f62-c90a-45ac-8058-139fee34d59e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.200070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.201408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.202079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.203525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] PATH_INFO: `/v3/projects/f34982349d084c2dbd92e469b38291ce` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.206209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34982349d084c2dbd92e469b38291ce)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.208871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.259612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:21.282585 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34982349d084c2dbd92e469b38291ce', 'request_id': 'req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.298540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34982349d084c2dbd92e469b38291ce', 'request_id': 'req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.330408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34982349d084c2dbd92e469b38291ce', 'request_id': 'req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.400562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] The token cache is being invalidate because project f34982349d084c2dbd92e469b38291ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:21.400900 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.401918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6c54f03f-3704-4cd1-95e1-a315d3e7aee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.405527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1162/2321] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:21 2022] DELETE /identity/v3/projects/f34982349d084c2dbd92e469b38291ce => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:21.411567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.412430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.412730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.455767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:21.462286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.653033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1160/2322] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:21.666912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.668133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.668960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.740468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:21.744006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.779587 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1163/2323] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:21.785556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.818646 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561c7cd-9dac-4368-9c6f-d6dfdd7a8ac7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.837076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.838410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.838826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.839290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.840426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:21.841198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.847988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.899187 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1161/2324] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:21.904027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.930644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e655e2-781d-466a-aac0-bfd3e00a279c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.956495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.957641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.958172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.959118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.959856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.963758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.074827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1164/2325] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:22.079426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:22.117918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c287-dd95-4a03-9fb3-cc185f71fe93 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:22.202673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:22.281896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:22.281896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.281896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.281896 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.282683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:22.282683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.325282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1162/2326] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:22 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:22.330456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:22.360860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba890-0b29-4f5b-b4b0-9c801d02d393 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:22.374401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:22.375057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.375349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.375630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.376318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:22.378041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.412460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1165/2327] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:22.416517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:22.427875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c557-021c-4e04-b266-f9000ec05d7f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:22.447448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:22.448092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.448381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.448662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.449323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:22.450975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a1527-7b22-47dc-ba2d-47476de0a47b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.472116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:22.481084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1163/2328] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:22.494171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc90c0a-8de2-4644-a004-637b43d25b67 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:22.515416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:22.516718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.517254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.517806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] PATH_INFO: `/v3/projects/52999ef3614348c188275726dbc67ea2/users/cb7e9f51f7e3443d8e692e7401446fe8/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.558669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52999ef3614348c188275726dbc67ea2, user_id=cb7e9f51f7e3443d8e692e7401446fe8, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:22.561254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.604186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.604587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.604871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.608773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1166/2329] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:22 2022] PUT /identity/v3/projects/52999ef3614348c188275726dbc67ea2/users/cb7e9f51f7e3443d8e692e7401446fe8/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:22.676012 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] MFA Rules not processed for user `cb7e9f51f7e3443d8e692e7401446fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:22.678391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:22.820975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1164/2330] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:22.830359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:22.832323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:23.041846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb58a-13e3-4887-96d1-d73eceb1fb34 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:23.053232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:23.055441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:23.055955 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:23.056387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:23.071935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:23.074250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9413d3-3cf6-4c67-846b-eb99223b4181 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:23.110489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1167/2331] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:29.577326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:29.692148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f17d-ce1c-4715-bce3-901c8bfebc2f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:29.709024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:29.711076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.711513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.712120 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] PATH_INFO: `/v3/users/cb7e9f51f7e3443d8e692e7401446fe8` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.713535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7e9f51f7e3443d8e692e7401446fe8)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:29.716243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.824654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.840384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7e9f51f7e3443d8e692e7401446fe8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:29.842288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7e9f51f7e3443d8e692e7401446fe8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:29.843534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7e9f51f7e3443d8e692e7401446fe8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:29.874573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7e9f51f7e3443d8e692e7401446fe8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:29.884494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7e9f51f7e3443d8e692e7401446fe8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:29.899210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1165/2332] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:29 2022] DELETE /identity/v3/users/cb7e9f51f7e3443d8e692e7401446fe8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:29.905971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.906775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.906942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.932461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:29.933702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:29.999971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:30.019581 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1168/2333] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:30.027632 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:30.029336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:30.122222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08627cdd-8ff0-4e09-9097-5ddef0af7737 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:30.126334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:30.127565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.127994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.128515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.140811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:30.142391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24a07-701b-4f0d-b8b9-fecb96064959 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:30.153368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1166/2334] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:30.545429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:30.548036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:30.595491 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d310c-fe7b-4e20-b8b5-ce128b0cfdf9 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:30.604278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:30.605492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.606058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.606800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] PATH_INFO: `/v3/projects/52999ef3614348c188275726dbc67ea2` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.608783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52999ef3614348c188275726dbc67ea2)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:30.612481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:30.682733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52999ef3614348c188275726dbc67ea2', 'request_id': 'req-dfd530fb-b15d-465a-af64-394e570fdf4c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:30.694654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52999ef3614348c188275726dbc67ea2', 'request_id': 'req-dfd530fb-b15d-465a-af64-394e570fdf4c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:30.705738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52999ef3614348c188275726dbc67ea2', 'request_id': 'req-dfd530fb-b15d-465a-af64-394e570fdf4c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:30.725574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] The token cache is being invalidate because project 52999ef3614348c188275726dbc67ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:30.726539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:30.727222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-dfd530fb-b15d-465a-af64-394e570fdf4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:30.728891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1169/2335] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:30 2022] DELETE /identity/v3/projects/52999ef3614348c188275726dbc67ea2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:30.735375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358de390-529c-4991-bef3-c4bfd9d03d49 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.736295 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358de390-529c-4991-bef3-c4bfd9d03d49 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.737917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358de390-529c-4991-bef3-c4bfd9d03d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.762538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-358de390-529c-4991-bef3-c4bfd9d03d49 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:30.764148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-358de390-529c-4991-bef3-c4bfd9d03d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:30.865371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.865656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.866030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.871247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1167/2336] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:30.892861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:30.898586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:30.910029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1170/2337] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:30.915553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697c35-ee53-400d-86eb-625f94de885d None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.915934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697c35-ee53-400d-86eb-625f94de885d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.916216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697c35-ee53-400d-86eb-625f94de885d None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.917898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1168/2338] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:55:30.918792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:30.926065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.926316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.926444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.940173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9523-9b34-4e83-a54f-307cecbd8e3f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:30.950309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:30.952381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:30.952854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:30.953678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:30.953987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:30.954320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:30.955234 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:30.955557 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:30.958898 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:30.983545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1171/2339] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:30.989144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.011316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab3d3-a1a0-461d-a87c-0ca08f45346b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.024246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.025241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.025597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.025912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.026915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.031238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.113179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:31.119161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1172/2340] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:30 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:31.128993 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.149754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1169/2341] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:55:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:31.175460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.177042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:31.299641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367915d4-24f2-40e7-b5ef-daf2ae548713 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.311288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.312218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.312794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.313434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.314519 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.317037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.343015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32da02-ba9c-4590-9ce6-a3a5ce08a3aa None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.362715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1173/2342] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:31 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:31.369613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.388884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4f6ff-9aa0-4fdf-91fb-eeb6cb11c74a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.397949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.399114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.399114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.399415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.400093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.403040 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.452439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1174/2343] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:31.453943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.465910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.466842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.467280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.467744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.477622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c887e-1070-424d-9938-71373d5acd82 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.487929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.488851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.489436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.489964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.491464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.494382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.516745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1175/2344] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:31.520756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.532729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2b1d-b4ad-4b4e-b0b5-5233ab3002d7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.540482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.541328 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.543655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.543655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] PATH_INFO: `/v3/projects/5d770e98251340f587a52a06ebd1cb7f/users/77f5a3fd5aa4427d9d48b87d9913a0c3/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.547037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:31.568544 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d770e98251340f587a52a06ebd1cb7f, user_id=77f5a3fd5aa4427d9d48b87d9913a0c3, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.571951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0bb5-572f-4109-a390-fab79f7086e4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.590092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1176/2345] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:31 2022] PUT /identity/v3/projects/5d770e98251340f587a52a06ebd1cb7f/users/77f5a3fd5aa4427d9d48b87d9913a0c3/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:31.597192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.597713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.598273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.607350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.608965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d67a1-ed91-4026-9261-5eab8f83adf2 service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.622929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1170/2346] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:31.626725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:31.627956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:31.715826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caf42-5522-4d89-ba51-b932da305fbb None None] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.716172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caf42-5522-4d89-ba51-b932da305fbb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.716558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caf42-5522-4d89-ba51-b932da305fbb None None] PATH_INFO: `/` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.718887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1171/2347] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:55:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:55:31.725392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.726025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.726556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.729274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1177/2348] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:31.742837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.744256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:31.758490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] MFA Rules not processed for user `1e4d0e7360db4d7db2bfe7ef1b0c2aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:31.760491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:31.846176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:31.858890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1172/2349] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:55:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:31.859356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f410f-88a1-4caa-89db-8e93d93807b5 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.864069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.865107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.865618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.866161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.875656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.877935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:31.888976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.892613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83ced3-335e-480e-a93f-f9d3b2a134df service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.896697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c74823-a172-4896-b545-a0ee42104ce0 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.902513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.903230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.904513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.905076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.911608 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1178/2350] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:31.918491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.919870 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d025-9d1a-48ed-8210-9bb343b17d86 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:31.929090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1173/2351] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:32.036646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d12c-b5fa-4add-89a4-100284d29c44 None None] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:32.037204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d12c-b5fa-4add-89a4-100284d29c44 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:32.037755 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d12c-b5fa-4add-89a4-100284d29c44 None None] PATH_INFO: `/` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:32.040703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1179/2352] 10.222.0.61 () {54 vars in 921 bytes} [Wed Aug 24 05:55:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:55:32.047176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bfe05-74f3-4113-9f44-abfce4472f0f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:32.048162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bfe05-74f3-4113-9f44-abfce4472f0f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:32.048437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bfe05-74f3-4113-9f44-abfce4472f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:32.074150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c44bfe05-74f3-4113-9f44-abfce4472f0f None None] MFA Rules not processed for user `640894aa402744af861080d8d0d80f66`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:32.075316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c44bfe05-74f3-4113-9f44-abfce4472f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:32.162852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1174/2353] 10.222.0.61 () {58 vars in 1018 bytes} [Wed Aug 24 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:32.184620 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d12c-b5fa-4add-89a4-100284d29c44 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:32.215991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d12c-b5fa-4add-89a4-100284d29c44 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:32.220905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:32.223077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:32.223077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:32.223603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:32.236305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:32.237754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:32.257545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1180/2354] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:33.024282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:33.025111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:33.025322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:33.073755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] MFA Rules not processed for user `77f5a3fd5aa4427d9d48b87d9913a0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:33.075910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:33.173590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1175/2355] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:33.192614 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:33.195468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:33.278736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14649d57-4191-4cfe-892b-2a2433d563b2 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:33.282504 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:33.283114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:33.283395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:33.283670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:33.293126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:33.294599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:33.304132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1181/2356] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:34.469426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:34.472486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.496016 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:34.498815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.542444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:34.601673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9920d-8c7c-4a26-ad83-86dfea344a9c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:34.608344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:34.609254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:34.609860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:34.610293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:34.612331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.632960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:34.636158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b820d-6b59-4f74-8c47-cca6e9beb0e6 service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:34.637607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e5a7-e7f6-45c3-936e-8c8df94c8457 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:34.644942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:34.650776 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:34.651733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:34.652097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:34.652495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:34.657026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1176/2357] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:34.673632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:34.676789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22b356-8c6c-45c1-a588-f052b2837097 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:34.697015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1182/2358] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:34.849430 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:34.849711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:34.850004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:34.885223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:34.886613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.896109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1177/2359] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:34.902732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffa573-c3b3-4506-9dd5-975df2498af2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:34.903171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffa573-c3b3-4506-9dd5-975df2498af2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:34.903525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffa573-c3b3-4506-9dd5-975df2498af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:34.927630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:34.929440 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.933904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ebffa573-c3b3-4506-9dd5-975df2498af2 None None] MFA Rules not processed for user `77f5a3fd5aa4427d9d48b87d9913a0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:34.935480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ebffa573-c3b3-4506-9dd5-975df2498af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:34.943239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1183/2360] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:55:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:34.949791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0d92-68b4-44ec-8b12-801c8d69b6af None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:34.959481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:34.961524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:34.961918 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:34.962184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:34.976235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:34.978025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:34.993044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1178/2361] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:39.057012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905cc1-7a89-4dbd-bc74-6771af17aaac None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:39.057849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905cc1-7a89-4dbd-bc74-6771af17aaac None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:39.058006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905cc1-7a89-4dbd-bc74-6771af17aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:39.083639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bf905cc1-7a89-4dbd-bc74-6771af17aaac None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:39.085666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bf905cc1-7a89-4dbd-bc74-6771af17aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:39.098064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1184/2362] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:39.119927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:39.144615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b697-6bb2-4178-bb8a-93bf4b494adf service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:39.159682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:39.160730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:39.161143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:39.161567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:39.172959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:39.174914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:39.192929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1179/2363] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:41.774079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd8b4-31c8-467d-836b-76ca88d652fc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:41.774559 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd8b4-31c8-467d-836b-76ca88d652fc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:41.774649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd8b4-31c8-467d-836b-76ca88d652fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:41.799021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-96ffd8b4-31c8-467d-836b-76ca88d652fc None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:41.800263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-96ffd8b4-31c8-467d-836b-76ca88d652fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:41.865867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1185/2364] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:55:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:41.891957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:41.893680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:41.991013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701d-9877-4698-9cbe-53ea4bad0f4c service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:41.997595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:41.998469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:41.998852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:41.999318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.022876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:42.025805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:42.038277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1180/2365] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:55:42.662938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553efd-2eb1-48c0-9801-b393a1220259 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:42.663923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553efd-2eb1-48c0-9801-b393a1220259 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:42.664696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553efd-2eb1-48c0-9801-b393a1220259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.702926 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b0553efd-2eb1-48c0-9801-b393a1220259 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:42.705124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b0553efd-2eb1-48c0-9801-b393a1220259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:42.722201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1186/2366] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:42.746997 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:42.766363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada34ec-e8aa-482f-a139-1355466ceb04 service swift] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:42.774019 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:42.775037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:42.775843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:42.776334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.796537 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:42.799046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:42.822265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1181/2367] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:52.692444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=58 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:52.809026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=54 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:59.266749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbfd0-0c2e-4d8e-aede-47de4ad13d18 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.267395 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbfd0-0c2e-4d8e-aede-47de4ad13d18 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.267989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbfd0-0c2e-4d8e-aede-47de4ad13d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.298573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b97dbfd0-0c2e-4d8e-aede-47de4ad13d18 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:59.299908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b97dbfd0-0c2e-4d8e-aede-47de4ad13d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:59.309330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1187/2368] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:59.328494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:59.330022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:59.345022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63cd46-3434-400c-bc75-3cf509b503b3 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:59.351105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:59.351957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.351957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.352349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.363489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:59.366636 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:59.382211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1182/2369] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:03.544441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb13e6-ac15-457b-8dcf-00dd3c128980 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:03.545204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb13e6-ac15-457b-8dcf-00dd3c128980 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:03.545204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb13e6-ac15-457b-8dcf-00dd3c128980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:03.579331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-91bb13e6-ac15-457b-8dcf-00dd3c128980 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:03.580547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-91bb13e6-ac15-457b-8dcf-00dd3c128980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:03.589459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1188/2370] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:56:03.608506 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:03.620200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93ce2-a4cc-46fe-a6c7-676c08226242 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:03.626784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:03.627422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:03.627701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:03.627974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:03.642400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:03.644023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:03.654968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1183/2371] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:04.670935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f13c-7d81-4709-9258-cc89f64fcd79 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.673245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f13c-7d81-4709-9258-cc89f64fcd79 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.673788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822f13c-7d81-4709-9258-cc89f64fcd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.708732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a822f13c-7d81-4709-9258-cc89f64fcd79 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:04.710828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a822f13c-7d81-4709-9258-cc89f64fcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:04.723818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1189/2372] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 05:56:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:04.739861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:04.752993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a44033-131a-44f9-b5d9-21645b52774d service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:04.760577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:04.761212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.761498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.761793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.773420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:04.774987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:04.784640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1184/2373] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:56:07.797185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f770-cff1-4a36-8a3e-34e28a157512 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:07.797924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f770-cff1-4a36-8a3e-34e28a157512 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:07.798237 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f770-cff1-4a36-8a3e-34e28a157512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:07.831389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e561f770-cff1-4a36-8a3e-34e28a157512 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:07.833987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e561f770-cff1-4a36-8a3e-34e28a157512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:07.847834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1190/2374] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:07.866785 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:07.887752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812615-5b14-4e25-8bfa-8f92b4e3760b service swift] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:07.894045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:07.894615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:07.894928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:07.895179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:07.904939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:07.906578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9c32-0dd9-4a09-92e2-69daa10b6db4 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:07.921519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1185/2375] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:14.325641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27a03-004b-4bcc-8d86-c6b3a9eb1b63 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:14.326386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27a03-004b-4bcc-8d86-c6b3a9eb1b63 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:14.326386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27a03-004b-4bcc-8d86-c6b3a9eb1b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:14.346998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-88b27a03-004b-4bcc-8d86-c6b3a9eb1b63 None None] MFA Rules not processed for user `77f5a3fd5aa4427d9d48b87d9913a0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:14.348269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-88b27a03-004b-4bcc-8d86-c6b3a9eb1b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:14.355845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1191/2376] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:56:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:17.912839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=24 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:24.341272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=15 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:27.466797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b389-e38c-473e-abe5-1dff7c2ab105 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:27.467349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b389-e38c-473e-abe5-1dff7c2ab105 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:27.467349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b389-e38c-473e-abe5-1dff7c2ab105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:27.487609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-06b8b389-e38c-473e-abe5-1dff7c2ab105 None None] MFA Rules not processed for user `ef4f4ca36fd044cc8835ac50a2696023`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:27.488879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-06b8b389-e38c-473e-abe5-1dff7c2ab105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:27.559939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1186/2377] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:56:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:36.670194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:36.670764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:36.670764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:36.708140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] MFA Rules not processed for user `74a53d36cb7549479e0d4692ffde1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:36.710464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:36.806307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1192/2378] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:37.552219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=25 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:42.531108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63bff-5a68-4931-99bd-97236be63f10 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:42.531734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63bff-5a68-4931-99bd-97236be63f10 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:42.531734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63bff-5a68-4931-99bd-97236be63f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:42.551431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-dcb63bff-5a68-4931-99bd-97236be63f10 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:42.552649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-dcb63bff-5a68-4931-99bd-97236be63f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:42.561538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1187/2379] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:56:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:42.596279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:42.609806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547521d-a3b5-43e2-88b6-b1ddd8f21865 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:42.615737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:42.616412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:42.616685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:42.616967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:42.626374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:42.627991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:42.639133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1193/2380] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:49.621156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d74b-f7b7-457b-a829-f0146731c453 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:49.622128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d74b-f7b7-457b-a829-f0146731c453 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:49.622128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d74b-f7b7-457b-a829-f0146731c453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:49.652714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5fb0d74b-f7b7-457b-a829-f0146731c453 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:49.654306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5fb0d74b-f7b7-457b-a829-f0146731c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:49.663199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1188/2381] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:49.703759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:49.725913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132809-6dd0-4619-b8c4-8aae77cc9201 service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:49.740524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:49.741816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:49.742693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:49.742865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:49.762197 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:49.762479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:49.782879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1194/2382] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:55.392498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608849ff-54df-4965-b90d-7740e194a0d7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.393602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608849ff-54df-4965-b90d-7740e194a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.394248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608849ff-54df-4965-b90d-7740e194a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.475722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-608849ff-54df-4965-b90d-7740e194a0d7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:55.479094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-608849ff-54df-4965-b90d-7740e194a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:55.496998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1189/2383] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:55.537359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:55.564203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0aa3-ea5d-4c0c-8df6-dd302bfaa59e service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:55.572579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:55.574165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.575025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.575817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.590165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:55.593265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:55.612187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1195/2384] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:59.594678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357ae-2329-49b0-b57b-b2dd5ef422af None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:59.596483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357ae-2329-49b0-b57b-b2dd5ef422af None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:59.596483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357ae-2329-49b0-b57b-b2dd5ef422af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:59.631141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f51357ae-2329-49b0-b57b-b2dd5ef422af None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:59.633103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f51357ae-2329-49b0-b57b-b2dd5ef422af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:59.646279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1190/2385] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:59.689287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:59.710662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a35bdb-5f4a-4704-895a-3731506af7bb service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:59.720824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:59.721935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:59.722732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:59.723486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:59.744472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:59.747697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:59.787967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1196/2386] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:02.653648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:02.654161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:02.654304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:02.681312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:02.682570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:02.690462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1191/2387] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 05:57:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:02.703791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:02.717340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82c06-3558-4018-8896-d1ca7939e826 service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:02.738893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:02.739601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:02.740006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:02.740358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:02.749801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:02.751400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:02.760523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1197/2388] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:57:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:05.144441 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:05.166165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7ddfc-9bc7-4899-bcfc-af57cf7fed10 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:05.171124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:05.171972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:05.172340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:05.172687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] PATH_INFO: `/v3/users/77f5a3fd5aa4427d9d48b87d9913a0c3` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:05.174496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f5a3fd5aa4427d9d48b87d9913a0c3)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:05.176818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:05.277256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f5a3fd5aa4427d9d48b87d9913a0c3'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.279007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f5a3fd5aa4427d9d48b87d9913a0c3'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.279892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f5a3fd5aa4427d9d48b87d9913a0c3'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.302709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f5a3fd5aa4427d9d48b87d9913a0c3'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.316973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d1017a0f-72f7-4da3-b741-30ca24431d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f5a3fd5aa4427d9d48b87d9913a0c3'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.347234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1192/2389] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:57:05 2022] DELETE /identity/v3/users/77f5a3fd5aa4427d9d48b87d9913a0c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:05.650177 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:05.658420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=56 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:05.670475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ee5d-e328-4f30-ab44-03be482d0452 service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:05.775404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:05.777065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:05.777470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:05.777949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] PATH_INFO: `/v3/projects/5d770e98251340f587a52a06ebd1cb7f` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:05.780020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d770e98251340f587a52a06ebd1cb7f)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:05.782514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:05.848850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d770e98251340f587a52a06ebd1cb7f', 'request_id': 'req-292d0087-9b09-45e1-a473-0c82631def8d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.857908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d770e98251340f587a52a06ebd1cb7f', 'request_id': 'req-292d0087-9b09-45e1-a473-0c82631def8d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.871092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d770e98251340f587a52a06ebd1cb7f', 'request_id': 'req-292d0087-9b09-45e1-a473-0c82631def8d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.891857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] The token cache is being invalidate because project 5d770e98251340f587a52a06ebd1cb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:57:05.892474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.893695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-292d0087-9b09-45e1-a473-0c82631def8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:05.896359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1198/2390] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:57:05 2022] DELETE /identity/v3/projects/5d770e98251340f587a52a06ebd1cb7f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:05.902318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb5d-d81c-4529-8c70-59a701cc596a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:05.902972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb5d-d81c-4529-8c70-59a701cc596a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:05.903582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb5d-d81c-4529-8c70-59a701cc596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:05.940335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-5394eb5d-d81c-4529-8c70-59a701cc596a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:05.943239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-5394eb5d-d81c-4529-8c70-59a701cc596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:05.983352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:05.984562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:05.985144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.018384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:06.021427 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:06.055574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1193/2391] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:06.063772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.064233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.064737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.138713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:06.140743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:06.155693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1194/2392] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:57:06.160981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.180895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1199/2393] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:06.190215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f85a5-d54e-45b3-b637-c461cc5aa74a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.199244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.200644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.201355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.202990 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.204279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:57:06.205074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.208425 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.230185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.231945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1195/2394] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:57:06.234694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:06.245649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.274349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98117e13-fa77-4329-9342-87aa86379f7e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.284520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.285630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.286245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.286962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.288354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.294270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.322392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:06.342712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:06.368260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1196/2395] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:57:06 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:06.373799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.416817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948b57-dd87-424f-84be-f0f756f76a2f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.543961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4b9f4-b55e-40aa-8d5d-78756d819103 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.574253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.574896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.575184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.575466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.577431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.579639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.579927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.581824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.582902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.590082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.595443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.598968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f08e1f-78d3-4048-b564-ee89daccbc06 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.617640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1200/2396] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:06.619137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13882dc-48ab-43cf-9415-3ebccf607e69 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.619429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13882dc-48ab-43cf-9415-3ebccf607e69 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.619710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13882dc-48ab-43cf-9415-3ebccf607e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.626363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1197/2397] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:57:06 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:06.631560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.651849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad31a8-a148-4e54-bfc9-b6b6fb92eaf4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.652863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d13882dc-48ab-43cf-9415-3ebccf607e69 None None] MFA Rules not processed for user `4c62008668ca423dab42c576bb735b70`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:06.654382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d13882dc-48ab-43cf-9415-3ebccf607e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:06.665721 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.666984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.667507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.668005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.669920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.674784 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.702107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1198/2398] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:57:06.703429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.716771 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81991f3-b220-4baf-abbb-9df718bd85be admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.726129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.727290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.727943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.728937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.730091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.734619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.756750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1199/2399] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:57:06.762757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:06.767136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1201/2400] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:06.780548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d761a2-34b6-4d62-9dd5-42ce3fa37f1f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:06.789514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:06.790606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.790965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.791366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] PATH_INFO: `/v3/projects/e1c1321b7ea74707a3362528e0f6f505/users/a085db04ce4d41bca07b2efcb1cdfc0d/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.813945 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c1321b7ea74707a3362528e0f6f505, user_id=a085db04ce4d41bca07b2efcb1cdfc0d, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:06.818894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:06.863194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1200/2401] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:57:06 2022] PUT /identity/v3/projects/e1c1321b7ea74707a3362528e0f6f505/users/a085db04ce4d41bca07b2efcb1cdfc0d/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:57:06.867014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:06.867457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:06.867809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:06.926285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] MFA Rules not processed for user `a085db04ce4d41bca07b2efcb1cdfc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:06.928678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:07.021895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:07.054653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1202/2402] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:57:07.067220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:07.069402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:07.153424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2bd41-dc0d-4652-8d6f-21a5b5e12aa4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:07.157563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:07.158270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:07.158535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:07.159015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:07.176054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:07.179528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783adcff-7ef8-4eeb-8567-8b3b9bb41506 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:07.197285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1201/2403] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:07.236537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:07.345882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7e912-a416-4218-a553-155b1519bee1 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:07.353561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:07.354645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:07.354953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:07.355770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] PATH_INFO: `/v3/users/a085db04ce4d41bca07b2efcb1cdfc0d` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:07.356766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a085db04ce4d41bca07b2efcb1cdfc0d)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:07.363332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:07.442500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a085db04ce4d41bca07b2efcb1cdfc0d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:07.443453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a085db04ce4d41bca07b2efcb1cdfc0d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:07.460814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a085db04ce4d41bca07b2efcb1cdfc0d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:07.461813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a085db04ce4d41bca07b2efcb1cdfc0d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:07.472143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a085db04ce4d41bca07b2efcb1cdfc0d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:07.488648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1203/2404] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:57:07 2022] DELETE /identity/v3/users/a085db04ce4d41bca07b2efcb1cdfc0d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:07.494621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:07.495032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:07.495388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:07.519895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:07.521153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:07.579700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:07.607260 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1202/2405] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:07.621734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:07.624492 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:07.737162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185f0d-7765-4000-951c-f2462c2aa70b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:07.744141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:07.745088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:07.745397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:07.745680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:07.762840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:07.765029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70a3eb-1171-4ffc-88d2-2cdb82827943 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:07.781469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1204/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:08.233105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:08.235323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:08.252890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8bb57-be46-48e7-b511-80f16c3aadf8 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:08.259211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:08.259211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:08.259544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:08.260743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] PATH_INFO: `/v3/projects/e1c1321b7ea74707a3362528e0f6f505` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:08.261490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c1321b7ea74707a3362528e0f6f505)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:08.263131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:08.328208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c1321b7ea74707a3362528e0f6f505', 'request_id': 'req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:08.336165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c1321b7ea74707a3362528e0f6f505', 'request_id': 'req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:08.342757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c1321b7ea74707a3362528e0f6f505', 'request_id': 'req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:08.358934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] The token cache is being invalidate because project e1c1321b7ea74707a3362528e0f6f505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:57:08.359225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:08.359909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:08.361546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1203/2407] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:57:08 2022] DELETE /identity/v3/projects/e1c1321b7ea74707a3362528e0f6f505 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:10.201330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ec08-f789-4f36-a2a3-8c3f09f1920a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:10.204139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ec08-f789-4f36-a2a3-8c3f09f1920a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:10.204974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ec08-f789-4f36-a2a3-8c3f09f1920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:10.235043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a211ec08-f789-4f36-a2a3-8c3f09f1920a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:10.237751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a211ec08-f789-4f36-a2a3-8c3f09f1920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:10.259990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:10.345281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1205/2408] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 05:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:10.368767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:10.371113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:10.495134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b5c2b-311f-4dc8-8f6b-04aa84f38db2 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:10.507004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:10.507651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:10.507969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:10.508218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:10.518064 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:10.519674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:10.531105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1204/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:11.579407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:11.580485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:11.580677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:11.607902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] MFA Rules not processed for user `e47e1b7589bb427aa13c27f7bc1d6d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:11.609134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:11.672747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1206/2410] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:20.526006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:21.665689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=46 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:28.274421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:28.276118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:28.338301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7c1a-0b36-4466-a7f5-2e7316b24e5f service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:28.342224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:28.342865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:28.343146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:28.343422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:28.345979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:28.361304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:28.363209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:28.374589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1205/2411] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:38.369576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=26 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:41.750161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:41.751824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:41.773602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadacdd-df6d-46aa-87a0-c45276ea7a39 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:41.778330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:41.778979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:41.779268 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:41.779552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] PATH_INFO: `/v3/users/ef4f4ca36fd044cc8835ac50a2696023` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:41.780826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4f4ca36fd044cc8835ac50a2696023)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:41.783513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:41.843018 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4f4ca36fd044cc8835ac50a2696023'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:41.843696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4f4ca36fd044cc8835ac50a2696023'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:41.860408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4f4ca36fd044cc8835ac50a2696023'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:41.861200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4f4ca36fd044cc8835ac50a2696023'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:41.869503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a1eff659-a753-484c-b33d-012ae39162ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4f4ca36fd044cc8835ac50a2696023'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:41.886036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1207/2412] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:57:41 2022] DELETE /identity/v3/users/ef4f4ca36fd044cc8835ac50a2696023 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:42.084054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.095802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b9d7d-71ee-480e-b8c4-c212236d6fb5 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.166572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.167123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.167412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.167694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] PATH_INFO: `/v3/projects/8096d58f3598419291842e24b0e9daed` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.168849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8096d58f3598419291842e24b0e9daed)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.170842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.231803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8096d58f3598419291842e24b0e9daed', 'request_id': 'req-1a166d52-4c26-46a1-bde2-fcc07cf34341'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:42.239367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8096d58f3598419291842e24b0e9daed', 'request_id': 'req-1a166d52-4c26-46a1-bde2-fcc07cf34341'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:42.247659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8096d58f3598419291842e24b0e9daed', 'request_id': 'req-1a166d52-4c26-46a1-bde2-fcc07cf34341'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:42.272171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] The token cache is being invalidate because project 8096d58f3598419291842e24b0e9daed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:57:42.272560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:42.273137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1a166d52-4c26-46a1-bde2-fcc07cf34341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:57:42.274847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1206/2413] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:57:42 2022] DELETE /identity/v3/projects/8096d58f3598419291842e24b0e9daed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:42.280180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.280520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.280731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.314920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:42.316133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:42.400467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1208/2414] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:57:42.409415 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.409717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.410023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.435869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:42.436998 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:42.449185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1207/2415] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:57:42.454891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.467149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df90fdd-7e73-4abc-b4d9-e2af9dd055d3 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.473116 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.473858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.474210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.474549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.475389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:57:42.475837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.478570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.498376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1209/2416] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:57:42.503414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.514525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e050474-1ad1-4201-a2c9-bc3ecb6af5eb None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.520444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.521075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.521363 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.521641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.522630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.524255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.560905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1208/2417] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:57:42 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:42.563409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.583995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2afd-891f-40fc-b3a9-1f43a37d0f45 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.679233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.680030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.680407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.680880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.681713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.683946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.694230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:42.725889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1210/2418] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:57:42 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:42.730439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.742642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e43330-d824-474b-a670-aab1e694c1e8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.747808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.748433 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.748740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.749022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.749881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.752069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.765409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1209/2419] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:57:42.769817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.784718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e98b2-29e5-46bf-a8ea-e5b4e3b888ca admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.791242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.792217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.792813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.793423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.794851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.800256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ccd41-ee1f-44bc-ac4d-78556cd53465 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.816188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1211/2420] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:57:42.820422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.831659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c74e0-29df-4209-a9cb-5dd6c3ccfec4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:42.836960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:42.837642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.838036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.838394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] PATH_INFO: `/v3/projects/b8baa30905d147c1ae17d09a48298c19/users/0f579c6c6db74e539c21a8a7f1357fce/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.856960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8baa30905d147c1ae17d09a48298c19, user_id=0f579c6c6db74e539c21a8a7f1357fce, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:42.860321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:42.876609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1210/2421] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:57:42 2022] PUT /identity/v3/projects/b8baa30905d147c1ae17d09a48298c19/users/0f579c6c6db74e539c21a8a7f1357fce/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:42.882225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:42.882790 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:42.883074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:42.907255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:42.908591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:42.986007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1212/2422] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:57:42.995398 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:42.997974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:43.042589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:43.076314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345363aa-d42f-4af8-b10b-c938ab5f6466 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:43.080040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:43.080653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:43.080939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:43.081217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:43.090987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:43.092452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda5745-be67-4274-8658-967cc92ab8f4 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:43.103244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1211/2423] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:44.983903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:44.985944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:45.051463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471006-8cf2-4c3b-b626-3707c2f84c7b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:45.056398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:45.057200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:45.057553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:45.057941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:45.062690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:45.160510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:45.161930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:45.176248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1213/2424] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:47.776553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:47.777290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:47.777452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:47.819472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] MFA Rules not processed for user `0f579c6c6db74e539c21a8a7f1357fce`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:47.820893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:47.916645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1212/2425] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:47.923508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:47.942330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6650d-b2a6-4c46-bcd0-45a23532abb8 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:47.947021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:47.947643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:47.947923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:47.948196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:47.949035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:47.950976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:47.978495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:47.990669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1214/2426] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:47.994641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:48.007230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc45a-abd4-4c16-9bbc-a1599930fe37 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:48.084799 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:48.085429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:48.085710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:48.086015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:48.086660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:48.088600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:48.115557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1213/2427] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:57:47 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:57:48.120514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:48.139369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7c5a4-6b28-4887-9b33-1504da9f454d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:48.150740 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:48.151448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:48.151737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:48.152027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:48.152699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:48.154503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:48.172502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1215/2428] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:57:48.177267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:48.193285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1522f-cb10-4bc8-981d-b68163d31e8b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:48.204604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:48.205304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:48.205593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:48.205926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] PATH_INFO: `/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f/users/dab39be0bd7042be8bedf44b0dceb0b4/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:48.246168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97bfdc30c0c41f9ba6f8e6ec6f6fb4f, user_id=dab39be0bd7042be8bedf44b0dceb0b4, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:48.251825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:48.274279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1214/2429] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:57:48 2022] PUT /identity/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f/users/dab39be0bd7042be8bedf44b0dceb0b4/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:48.278605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:48.291698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164cd4-c68b-4765-8aee-d2bfbcdb350e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:48.382064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:48.382697 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:48.382987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:48.383271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:48.383925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:48.385703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:48.403204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1216/2430] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:57:48.404965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:48.432022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed246e-7d0e-42f0-b29e-3ef3f77d51ad admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:48.440884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:48.441684 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:48.442095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:48.442456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] PATH_INFO: `/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f/users/dab39be0bd7042be8bedf44b0dceb0b4/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:48.444867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97bfdc30c0c41f9ba6f8e6ec6f6fb4f, user_id=dab39be0bd7042be8bedf44b0dceb0b4, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:48.449744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e16c0-3752-4111-95cb-68ab88cce3ae admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:48.471712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1215/2431] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:57:48 2022] PUT /identity/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f/users/dab39be0bd7042be8bedf44b0dceb0b4/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:53.756565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:53.761917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:53.858415 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf1451-213d-4e42-938d-796705b6b442 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:53.923181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:53.923854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:53.924113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:53.924428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:53.926411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:54.009023 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:54.019181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:54.020658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:54.033174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1217/2432] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:54.319396 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:54.319957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:54.319957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:54.351422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:54.368841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] MFA Rules not processed for user `dab39be0bd7042be8bedf44b0dceb0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:54.370993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:54.441598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:54.508750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1216/2433] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:54.529205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:54.530761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:54.663182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c23970-cce9-498b-b944-f852b52cd90e service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:54.708930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:54.709594 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:54.710114 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:54.710481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:54.715462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:54.719594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d005e-e4e9-4c3f-a523-f6b3c45af87b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:54.747093 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:54.747952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:54.748257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:54.748593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:54.882890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:54.886908 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:54.893006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:54.894511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa15da-fa4e-42bb-8560-f2427d9746a0 service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:54.914259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1217/2434] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:57:54.917606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1218/2435] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:55.126518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccea18-2c82-42bf-85e8-23436c756e74 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:55.127860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccea18-2c82-42bf-85e8-23436c756e74 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:55.128671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccea18-2c82-42bf-85e8-23436c756e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:55.161933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-00ccea18-2c82-42bf-85e8-23436c756e74 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:55.163250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-00ccea18-2c82-42bf-85e8-23436c756e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:55.247336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:55.264766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1218/2436] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:55.299919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:55.302264 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:55.437071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61335-0981-4c47-a199-b3680dd9c52e service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:55.445220 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:55.446391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:55.446809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:55.447233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:55.458357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:55.460226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:55.472240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1219/2437] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:56.279616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:56.280186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:56.280186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:56.303549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] MFA Rules not processed for user `74a53d36cb7549479e0d4692ffde1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:56.308553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:56.317015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1219/2438] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:57.472308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:57.475870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:57.570722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:57.614828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5c71-11ed-4fef-a85c-7be5f3128463 service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:57.621153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:57.621841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:57.622277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:57.622626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:57.625226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:57.645951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:57.647674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:57.663451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1220/2439] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:03.014621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:03.017292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:03.304451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb9b95-34be-4172-b4b3-ebff784e38fe None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:03.315769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:03.316815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:03.317305 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:03.317602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:03.319618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:03.355790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:03.359665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:03.385852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1220/2440] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:03.560296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:03.579329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4014-1241-43e2-bb95-3ac608610df3 service placement] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:03.596030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:03.597191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:03.597998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:03.599222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:03.605158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:03.640958 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:03.643298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c290-b661-46f8-a083-15c42c941950 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:03.678255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1221/2441] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:04.579292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:04.580905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:04.616254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6820-fa67-44fb-b918-c9f10c2238be service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:04.625999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:04.626973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:04.627456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:04.630744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:04.633030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:04.649924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:04.651837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:04.681413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1221/2442] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:07.260292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:07.261029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:07.261029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:07.282243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] MFA Rules not processed for user `0f579c6c6db74e539c21a8a7f1357fce`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:07.283470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:07.290876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1222/2443] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:07.563069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:07.572980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3700d7b-3416-44e3-9e01-48fe3c932305 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:07.576884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:07.578052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:07.578337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:07.578616 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:07.580434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:07.590581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:07.591932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661165-aac5-4c23-af36-a2ef1fc68f3a service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:07.601193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1222/2444] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:09.953534 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:09.971238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877b9db-67b9-49f1-b5c6-aaf350a207f9 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:09.979537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:09.980214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:09.980502 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:09.980813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:09.982756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:10.005269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:10.009452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:10.041597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1223/2445] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:11.098864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:11.099751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:11.100348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:11.133486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:11.135928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:11.147290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1223/2446] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:58:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:11.163901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:11.178662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3fe47-4ae9-4a2c-b3c2-bdbcd3601a28 service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:11.188729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:11.190215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:11.190946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:11.191244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:11.201251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:11.203456 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:11.215625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1224/2447] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:58:13.347111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:13.362257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821304-46b7-4e95-a2f0-8c58dbbeb4b7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:13.372312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:13.373211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:13.373671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:13.374126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:13.376117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:13.516290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:13.518758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:13.532325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1224/2448] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:21.211676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=36 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:23.524543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=82 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:27.443768 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:27.453618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da4f8-b440-4c47-9667-dc5bd7d943af service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:27.457121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:27.457714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:27.458058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:27.458336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:27.460066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:27.524603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:27.526140 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:27.536072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1225/2449] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:31.358950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:31.361027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:31.376353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1efec-aa8e-4a9a-8227-64b4e53407dd service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:31.382283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:31.382908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:31.383193 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:31.383470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:31.386529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:31.409904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:31.415078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:31.426773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:31.429102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:31.437562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1225/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:31.447616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908af7-0567-45eb-a719-c841dc1e1e31 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:31.458239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:31.459362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:31.459723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:31.460187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] PATH_INFO: `/v3/users/4c62008668ca423dab42c576bb735b70` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:31.461618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c62008668ca423dab42c576bb735b70)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:31.463825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:31.540597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c62008668ca423dab42c576bb735b70'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:31.541311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c62008668ca423dab42c576bb735b70'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:31.560312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c62008668ca423dab42c576bb735b70'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:31.561042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c62008668ca423dab42c576bb735b70'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:31.578383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-c2524ef7-53a4-47cf-8222-42fcfdd06ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c62008668ca423dab42c576bb735b70'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:31.593679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1226/2451] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:31 2022] DELETE /identity/v3/users/4c62008668ca423dab42c576bb735b70 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:31.916390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:31.930543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb0d77-daa4-444d-9868-ee4dd3b465e6 service placement] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.010560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.011210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.011494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.011776 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] PATH_INFO: `/v3/projects/7500f04f4b4641ee9a9c86ae3494695a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.012926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7500f04f4b4641ee9a9c86ae3494695a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.015548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.071973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7500f04f4b4641ee9a9c86ae3494695a', 'request_id': 'req-025da851-314e-4f05-8a0a-bcbf6a048220'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:32.078839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7500f04f4b4641ee9a9c86ae3494695a', 'request_id': 'req-025da851-314e-4f05-8a0a-bcbf6a048220'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:32.084505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7500f04f4b4641ee9a9c86ae3494695a', 'request_id': 'req-025da851-314e-4f05-8a0a-bcbf6a048220'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:32.098846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] The token cache is being invalidate because project 7500f04f4b4641ee9a9c86ae3494695a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:32.099144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:32.099813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-025da851-314e-4f05-8a0a-bcbf6a048220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:32.101395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1226/2452] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:31 2022] DELETE /identity/v3/projects/7500f04f4b4641ee9a9c86ae3494695a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:32.106538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.106830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.107113 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.127433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:32.128659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:32.196071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1227/2453] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:58:32.209336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.209849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.210334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.241939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:32.243743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:32.253651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1227/2454] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:32.258320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.269045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699a9df-d05c-47f6-9c20-841cd0ad41bf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.274818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.275433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.275725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.276027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.276684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:32.276996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.278750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.281027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:32.295545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1228/2455] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:32.299890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.311530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4674e3a-b3e4-4a76-a603-06c7c8e3d01c None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.318291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.318931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.319217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.319494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.320139 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.322122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.350687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1228/2456] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:32 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:32.355047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.365982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41ba58-f939-490a-903f-79dc42f2d3ee admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.436228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.436953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.436953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.437217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.438142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.440078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.464588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1229/2457] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:32 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:32.467724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.478596 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5b8e-b368-4a29-a377-bf3e216b4c70 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.484475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.485128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.485411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.485687 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.486370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.487975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.499365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1229/2458] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:32.508228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.518996 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac686c-6aa9-4fe5-a79b-1b363fd15f26 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.523761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.524378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.524661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.524938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.525590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.527224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054de6-3f03-4089-8319-d521c6b175e8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.539786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1230/2459] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:58:32.545792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.565875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015d0d-2730-40f9-91cd-535134f2092a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.573682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.574857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.575431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.575903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] PATH_INFO: `/v3/projects/9bb77040da184a0bb85800776bca1fb9/users/383e8123a9ed46beb4e3bc7446b1bd87/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.594418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb77040da184a0bb85800776bca1fb9, user_id=383e8123a9ed46beb4e3bc7446b1bd87, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.597203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.613813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1230/2460] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:32 2022] PUT /identity/v3/projects/9bb77040da184a0bb85800776bca1fb9/users/383e8123a9ed46beb4e3bc7446b1bd87/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:32.624770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.625100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.625374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.664225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] MFA Rules not processed for user `383e8123a9ed46beb4e3bc7446b1bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:32.665480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:32.740257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1231/2461] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:32.756110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:32.757904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:32.774667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:32.852451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f29c-d1c7-405c-9af5-223aeca2e02a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:32.859184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:32.859820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:32.860109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:32.860388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:32.869996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:32.871658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60605a73-2963-45f7-8575-6e9f673068fe service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:32.883936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1231/2462] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:58:33.269622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:33.363525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2ba24-e257-4d4e-85c8-5a68a20f927e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:33.368784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:33.369450 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:33.369977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:33.370194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] PATH_INFO: `/v3/users/383e8123a9ed46beb4e3bc7446b1bd87` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:33.375612 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=383e8123a9ed46beb4e3bc7446b1bd87)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:33.377602 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:33.380811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:33.444332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383e8123a9ed46beb4e3bc7446b1bd87'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:33.445178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383e8123a9ed46beb4e3bc7446b1bd87'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:33.461902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383e8123a9ed46beb4e3bc7446b1bd87'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:33.465670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383e8123a9ed46beb4e3bc7446b1bd87'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:33.477976 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383e8123a9ed46beb4e3bc7446b1bd87'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:33.492946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1232/2463] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:33 2022] DELETE /identity/v3/users/383e8123a9ed46beb4e3bc7446b1bd87 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:33.498250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:33.499155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:33.499704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:33.520865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:33.522153 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:33.600542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1232/2464] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:33.615555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:33.618251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:33.697999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159839-082f-4ebc-b4a1-217f1fc49ade admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:33.708606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:33.709728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:33.710318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:33.710820 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:33.727108 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:33.728907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc9b0-5ae2-4aad-9f95-f03e64344532 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:33.741249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1233/2465] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:34.201424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.202962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:34.216221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b116ad-f53b-4f3e-83ba-d9674e7f73f1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.222852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.223882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.224239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.224591 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] PATH_INFO: `/v3/projects/9bb77040da184a0bb85800776bca1fb9` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.231671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb77040da184a0bb85800776bca1fb9)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.234987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.310839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb77040da184a0bb85800776bca1fb9', 'request_id': 'req-953e2706-d316-4d5d-9cab-4db6ce9e555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:34.325276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb77040da184a0bb85800776bca1fb9', 'request_id': 'req-953e2706-d316-4d5d-9cab-4db6ce9e555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:34.340039 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb77040da184a0bb85800776bca1fb9', 'request_id': 'req-953e2706-d316-4d5d-9cab-4db6ce9e555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:34.361290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] The token cache is being invalidate because project 9bb77040da184a0bb85800776bca1fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:34.361685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:34.362569 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-953e2706-d316-4d5d-9cab-4db6ce9e555f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:34.365913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1233/2466] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:34 2022] DELETE /identity/v3/projects/9bb77040da184a0bb85800776bca1fb9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:34.371789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.372291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.372853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.410576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:34.412679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:34.514015 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1234/2467] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:34.520376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.521574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.522056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.559803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:34.561242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:34.583644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1234/2468] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:34.588627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.605226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97857b-3134-4f23-9285-e00030c0b968 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.612623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.613438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.613952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.614230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.614910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:34.615813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.617551 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.639640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1235/2469] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:34.640908 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.653216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f301a-372e-435d-9224-7ef59e42fd8d None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.661001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.661634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.662034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.662476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.663251 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.665500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.686619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:34.713704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1235/2470] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:34 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:34.715891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.733340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3408fed-fe9b-4f53-acb1-5291ea8e1b56 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.747127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:34.823838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.824749 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.825033 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.825311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.826599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.828495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e14a6-a758-4465-8c2d-c0f9634033fa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.851797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1236/2471] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:34 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:34.856825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.868865 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab75a9-b5ed-40d4-beec-87674be3344f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.874356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.874965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.875255 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.875526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.876231 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.877921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.883437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.883735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.884014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.891789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1236/2472] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:34.892937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.903107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ff1d1-8d48-4285-a3ed-be4c8b74340d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.905515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:34.906771 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:34.908381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.909062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.909411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.909623 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.910319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.911956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.922288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1237/2473] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:58:34.926850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.938077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05969993-2f4d-4dc1-9f47-29d5fd2cc436 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:34.943216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:34.943880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:34.944162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:34.944494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] PATH_INFO: `/v3/projects/65c3554c7a3b4c46bfcc876529888ff5/users/391cfba3672048efad4674b0eef25d1b/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:34.963970 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c3554c7a3b4c46bfcc876529888ff5, user_id=391cfba3672048efad4674b0eef25d1b, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:34.968474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1237/2474] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:58:34.968988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1a48d-1102-4ca3-a69f-f2e283d3369e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:34.981207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:34.982652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:34.989561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1238/2475] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:34 2022] PUT /identity/v3/projects/65c3554c7a3b4c46bfcc876529888ff5/users/391cfba3672048efad4674b0eef25d1b/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:35.007419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.007885 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.008182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.047092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] MFA Rules not processed for user `391cfba3672048efad4674b0eef25d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:35.048674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:35.069734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791d5a-87d7-4e93-b8a8-65ef03dc226e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.119010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:35.135238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1239/2476] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:35.140621 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:35.141609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.143002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.143002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.143495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.212913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.214580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:35.223382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1238/2477] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:58:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:58:35.241662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15f01-91e2-4376-9e2f-71fbdadbe6ba None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.251056 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.252130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.252671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.253347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.254563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.258837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:35.322757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1240/2478] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:35 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:35.323865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:35.338894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37236f4-a0d8-45e9-81e8-8bc147d65adf service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.451322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.451968 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.452253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.452531 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.453187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.455167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:35.495810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1239/2479] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:35 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:35.502475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:35.550247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e1fb-b52a-4e43-a80a-4ae3c24bfe65 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.564850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.566834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.570271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.572175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.572962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.575607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:35.623289 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1241/2480] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:35.628464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:35.670949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3a8d-90e0-4c75-aba8-0d7bf2e6361d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.681864 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.683370 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.684117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.685096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] PATH_INFO: `/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3/users/687efc33334c4ca5bad95559ee2283fc/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.727004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e50bf4ec2944412ab3dbc0b236dbda3, user_id=687efc33334c4ca5bad95559ee2283fc, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.733099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:35.829746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1240/2481] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:35 2022] PUT /identity/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3/users/687efc33334c4ca5bad95559ee2283fc/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:35.831208 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:35.845832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d164c1-e048-44a1-8997-608bd619dd50 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:35.858307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:35.985516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:35.986324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:35.986711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:35.987088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:35.987852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:35.991803 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82716658-f77c-458a-a7cc-5658f737e6de admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:36.009578 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1242/2482] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:36.013497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:36.033139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb94b4-b9f3-434c-b3fc-a4fce54ca7f8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:36.040265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:36.041356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:36.041741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:36.042272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] PATH_INFO: `/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3/users/687efc33334c4ca5bad95559ee2283fc/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:36.046329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e50bf4ec2944412ab3dbc0b236dbda3, user_id=687efc33334c4ca5bad95559ee2283fc, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:36.049965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:36.091407 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1241/2483] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:36 2022] PUT /identity/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3/users/687efc33334c4ca5bad95559ee2283fc/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:36.108501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:36.108926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:36.109311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:36.224878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] MFA Rules not processed for user `687efc33334c4ca5bad95559ee2283fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:36.226863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:36.471850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1243/2484] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:36.491151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:36.494115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:36.627447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:36.641482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d87f-0344-4967-ae90-4a9a9805bcd5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:36.646985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:36.648214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:36.648738 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:36.649214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:36.660627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:36.662453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0b075-d852-430e-8eef-487febd4b3d1 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:36.682077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1242/2485] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:58:36.942749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:37.134023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e4281-57ef-4f05-9c88-ef0cb3ea7256 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:37.144859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:37.145877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:37.146335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:37.146795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] PATH_INFO: `/v3/users/391cfba3672048efad4674b0eef25d1b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:37.148161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391cfba3672048efad4674b0eef25d1b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:37.151426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:37.235829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:37.271981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391cfba3672048efad4674b0eef25d1b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:37.273013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391cfba3672048efad4674b0eef25d1b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:37.275030 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391cfba3672048efad4674b0eef25d1b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:37.299657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391cfba3672048efad4674b0eef25d1b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:37.313940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391cfba3672048efad4674b0eef25d1b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:37.332961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1244/2486] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:36 2022] DELETE /identity/v3/users/391cfba3672048efad4674b0eef25d1b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:37.338824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:37.339200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:37.339489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:37.374556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:37.375925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:37.545582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1243/2487] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:37.554102 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:37.557098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:37.693729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6d79-e8f5-4972-b689-b2bcd97ba227 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:37.705755 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:37.707224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:37.707575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:37.708243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:37.739843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:37.739843 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:37.750158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1245/2488] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:38.179383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:38.198441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:38.266613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615508f-d49c-4d1d-9920-832a49c7b305 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:38.272333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:38.273470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:38.273946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:38.274430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] PATH_INFO: `/v3/projects/65c3554c7a3b4c46bfcc876529888ff5` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:38.275757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c3554c7a3b4c46bfcc876529888ff5)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:38.277983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:38.358745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c3554c7a3b4c46bfcc876529888ff5', 'request_id': 'req-37c899dd-b6bb-466e-90ce-12023b3b5cac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.381868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c3554c7a3b4c46bfcc876529888ff5', 'request_id': 'req-37c899dd-b6bb-466e-90ce-12023b3b5cac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.390998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c3554c7a3b4c46bfcc876529888ff5', 'request_id': 'req-37c899dd-b6bb-466e-90ce-12023b3b5cac'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.414279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] The token cache is being invalidate because project 65c3554c7a3b4c46bfcc876529888ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:38.414535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.415169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.417816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1244/2489] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:38 2022] DELETE /identity/v3/projects/65c3554c7a3b4c46bfcc876529888ff5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:38.423720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:38.441315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024423dd-58d4-4b5e-872b-88e0cbffd7cc service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:38.627519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:38.642101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:38.642597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:38.643069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] PATH_INFO: `/v3/users/687efc33334c4ca5bad95559ee2283fc` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:38.647840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687efc33334c4ca5bad95559ee2283fc)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:38.648963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:38.817267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687efc33334c4ca5bad95559ee2283fc'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.818518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687efc33334c4ca5bad95559ee2283fc'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.821505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687efc33334c4ca5bad95559ee2283fc'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.842782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:38.878438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687efc33334c4ca5bad95559ee2283fc'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.894156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687efc33334c4ca5bad95559ee2283fc'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:38.928170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1246/2490] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:38 2022] DELETE /identity/v3/users/687efc33334c4ca5bad95559ee2283fc => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:39.093121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:39.094784 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:39.194354 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c899dd-b6bb-466e-90ce-12023b3b5cac admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:39.225337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:39.285216 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:39.287127 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.287939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.288499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.291678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:39.353453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:39.354955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:39.405010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:39.408151 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0c1b-faf0-4a42-b6a1-5529459e357b service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:39.420918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1245/2491] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:39.461942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecf39f-c0d8-4f6f-9824-dd123a0aadd8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:39.470959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:39.471805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.472194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.472562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] PATH_INFO: `/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.473919 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e50bf4ec2944412ab3dbc0b236dbda3)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:39.476013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:39.576610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e50bf4ec2944412ab3dbc0b236dbda3', 'request_id': 'req-7f103cd8-90a3-49e1-8800-4773a1e2f4de'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:39.601161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e50bf4ec2944412ab3dbc0b236dbda3', 'request_id': 'req-7f103cd8-90a3-49e1-8800-4773a1e2f4de'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:39.613486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e50bf4ec2944412ab3dbc0b236dbda3', 'request_id': 'req-7f103cd8-90a3-49e1-8800-4773a1e2f4de'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:39.633928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] The token cache is being invalidate because project 2e50bf4ec2944412ab3dbc0b236dbda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:39.634611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:39.635416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7f103cd8-90a3-49e1-8800-4773a1e2f4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:39.641594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1247/2492] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:39 2022] DELETE /identity/v3/projects/2e50bf4ec2944412ab3dbc0b236dbda3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:39.644631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.645154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.645634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.677405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:39.679434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:39.761720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1246/2493] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:39.772786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4733e9-9348-438c-8109-d3031765527a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.773161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4733e9-9348-438c-8109-d3031765527a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.773534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4733e9-9348-438c-8109-d3031765527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.801220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3c4733e9-9348-438c-8109-d3031765527a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:39.803186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3c4733e9-9348-438c-8109-d3031765527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:39.820149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1248/2494] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:39.825800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:39.838609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948de71-894e-49ea-8243-6c684e28c30b None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:39.845481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:39.846669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.846669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.846870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.847688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:39.848043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:39.851200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:39.879781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1247/2495] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:39.880940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4733e9-9348-438c-8109-d3031765527a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:39.900758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4733e9-9348-438c-8109-d3031765527a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:39.908453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:39.909386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:39.909842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:39.910278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:39.911299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:39.914932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:39.981789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1249/2496] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:39 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:39.983314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.004247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556232-b462-494a-8ccd-04c7178d4cd9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.175170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.176384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.176902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.177428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.178406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.181484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.206227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:40.230930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1248/2497] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:39 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:40.235638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.255376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1285de-b9f6-4222-a17e-117222a71e62 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.265005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.265547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.265949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.266237 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.267141 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.270033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.285875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1250/2498] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:40.287851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.301253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba073e-9b7a-4669-b971-999ba7a5dc7a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.308017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.308806 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.309582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.312679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.314164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.316949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308fbe2-c010-40e5-9a12-df51ff1c5fac admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.333173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1249/2499] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:58:40.335203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.362249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ca58-dcb4-4d20-8224-12aea4c490ab admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.368866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.369559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.369950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.370254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] PATH_INFO: `/v3/projects/e9df42f5b6664a3a85f28a59d3e7baaa/users/ae8b032e628947b1ba74d07ac4082eed/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.394470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9df42f5b6664a3a85f28a59d3e7baaa, user_id=ae8b032e628947b1ba74d07ac4082eed, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.397399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.409388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:40.415648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1251/2500] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:40 2022] PUT /identity/v3/projects/e9df42f5b6664a3a85f28a59d3e7baaa/users/ae8b032e628947b1ba74d07ac4082eed/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:40.429271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.429700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.430125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.504333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] MFA Rules not processed for user `ae8b032e628947b1ba74d07ac4082eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:40.506524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:40.640288 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1250/2501] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:40.641420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.724972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf1b5-1243-440e-a842-42cc994cba29 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.742152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.742796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.743090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.743482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.744154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.746151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.791232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1252/2502] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:40 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:40.796625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.816070 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacdf40-825d-4e41-a919-2437a3ca7fe7 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.907160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.908078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.908521 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.908965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.909734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.911912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.940686 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1251/2503] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:40 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:40.941563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:40.955249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fcef-4f33-4556-9b91-7e8cbbb75dea admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:40.963413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:40.964653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:40.965312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:40.965912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:40.967744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:40.969858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:40.989805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1253/2504] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:40.990630 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:41.010971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc09a-fe57-4f4e-b286-5d69fb5a1688 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:41.019838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:41.021423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:41.022230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:41.022991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] PATH_INFO: `/v3/projects/c28f038f9fd0400ea365d48140c9434b/users/69805881b9de40aaa0abc5ce72f3a16d/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:41.052332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28f038f9fd0400ea365d48140c9434b, user_id=69805881b9de40aaa0abc5ce72f3a16d, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:41.058047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:41.082724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1252/2505] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:40 2022] PUT /identity/v3/projects/c28f038f9fd0400ea365d48140c9434b/users/69805881b9de40aaa0abc5ce72f3a16d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:41.088292 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:41.107108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e562948-631a-4bcb-9796-a702bca4d2f6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:41.227301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:41.228100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:41.229320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:41.229677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:41.230534 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:41.232835 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316fc81-3d40-476f-8ca2-e09976bd8547 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:41.249677 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1254/2506] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:58:41.250876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:41.265245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b35f-7ff2-4291-8d46-7dd600a40caa admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:41.272219 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:41.273212 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:41.273570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:41.273951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] PATH_INFO: `/v3/projects/c28f038f9fd0400ea365d48140c9434b/users/69805881b9de40aaa0abc5ce72f3a16d/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:41.276133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28f038f9fd0400ea365d48140c9434b, user_id=69805881b9de40aaa0abc5ce72f3a16d, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:41.279607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:41.306369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1253/2507] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:41 2022] PUT /identity/v3/projects/c28f038f9fd0400ea365d48140c9434b/users/69805881b9de40aaa0abc5ce72f3a16d/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:41.312951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:41.313731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:41.314210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:41.359738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] MFA Rules not processed for user `69805881b9de40aaa0abc5ce72f3a16d`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:41.361084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:41.476557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:41.512069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1255/2508] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:58:41.522932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:41.531244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:41.606761 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:41.682659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8159-ba4a-46f8-a00f-989054d89aab admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:41.696913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:41.697565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:41.697881 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:41.698152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:41.722694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:41.725034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fb226-1187-4def-9a93-682169312289 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:41.750387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1254/2509] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:42.415587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:42.529920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd694b-56b3-459f-9fae-7fa90db64cde None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:42.539316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:42.542050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:42.544455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:42.544804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] PATH_INFO: `/v3/users/ae8b032e628947b1ba74d07ac4082eed` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:42.547205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8b032e628947b1ba74d07ac4082eed)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:42.551705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:42.669498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8b032e628947b1ba74d07ac4082eed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:42.671767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8b032e628947b1ba74d07ac4082eed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:42.676961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8b032e628947b1ba74d07ac4082eed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:42.709743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8b032e628947b1ba74d07ac4082eed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:42.723466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8b032e628947b1ba74d07ac4082eed'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:42.754890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1256/2510] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:42 2022] DELETE /identity/v3/users/ae8b032e628947b1ba74d07ac4082eed => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:42.800298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:42.801489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:42.802024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:42.859886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:42.870733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:43.056017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1255/2511] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:43.175044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:43.176550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:43.291893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be452-6a08-4d43-a8b4-cb826b7cc6bc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:43.298297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:43.299594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:43.300122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:43.300589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:43.314611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:43.316339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:43.333921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1257/2512] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:44.083403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:44.086927 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:44.130681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2d437-fcac-4661-b241-eb2ab505e34c None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:44.137048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:44.138970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:44.139367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:44.139707 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] PATH_INFO: `/v3/projects/e9df42f5b6664a3a85f28a59d3e7baaa` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:44.141204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9df42f5b6664a3a85f28a59d3e7baaa)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:44.144754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:44.339589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9df42f5b6664a3a85f28a59d3e7baaa', 'request_id': 'req-f1060a69-c458-407b-8d1c-53c65c251549'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.358330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9df42f5b6664a3a85f28a59d3e7baaa', 'request_id': 'req-f1060a69-c458-407b-8d1c-53c65c251549'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.373004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9df42f5b6664a3a85f28a59d3e7baaa', 'request_id': 'req-f1060a69-c458-407b-8d1c-53c65c251549'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.391180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] The token cache is being invalidate because project e9df42f5b6664a3a85f28a59d3e7baaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:44.391617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.392398 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.399961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:44.401524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1256/2513] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:44 2022] DELETE /identity/v3/projects/e9df42f5b6664a3a85f28a59d3e7baaa => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:44.437084 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81d096-51c4-47a2-b0db-cd55f3c714d3 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:44.485728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:44.636387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:44.637392 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:44.638320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:44.638678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] PATH_INFO: `/v3/users/69805881b9de40aaa0abc5ce72f3a16d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:44.640206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69805881b9de40aaa0abc5ce72f3a16d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:44.642230 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:44.767615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69805881b9de40aaa0abc5ce72f3a16d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.768424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69805881b9de40aaa0abc5ce72f3a16d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.769250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69805881b9de40aaa0abc5ce72f3a16d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.817703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69805881b9de40aaa0abc5ce72f3a16d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.829296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2b5f3e00-2e1f-4851-911b-9b1468205f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69805881b9de40aaa0abc5ce72f3a16d'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:44.866842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1258/2514] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:44 2022] DELETE /identity/v3/users/69805881b9de40aaa0abc5ce72f3a16d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:45.261759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:45.263285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:45.294481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a69-c458-407b-8d1c-53c65c251549 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:45.398433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:45.427625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:45.429295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:45.429975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:45.430595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] PATH_INFO: `/v3/projects/c28f038f9fd0400ea365d48140c9434b` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:45.433894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28f038f9fd0400ea365d48140c9434b)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:45.438829 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:45.597574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28f038f9fd0400ea365d48140c9434b', 'request_id': 'req-afb6aeda-bd41-4423-962d-338be2f2ed40'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:45.610861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28f038f9fd0400ea365d48140c9434b', 'request_id': 'req-afb6aeda-bd41-4423-962d-338be2f2ed40'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:45.636735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28f038f9fd0400ea365d48140c9434b', 'request_id': 'req-afb6aeda-bd41-4423-962d-338be2f2ed40'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:45.661580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] The token cache is being invalidate because project c28f038f9fd0400ea365d48140c9434b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:45.663741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:45.663741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-afb6aeda-bd41-4423-962d-338be2f2ed40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:45.664185 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1257/2515] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:45 2022] DELETE /identity/v3/projects/c28f038f9fd0400ea365d48140c9434b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:45.671194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:45.671966 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:45.672130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:45.727821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:45.729103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:45.987175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1259/2516] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:45.994409 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:45.994990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:45.995457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.041071 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:46.042752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:46.066298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1258/2517] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:46.071759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.097682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfab2c2-3564-46eb-918e-200662565954 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.129112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.129913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.130277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.131038 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.132248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:46.132639 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.135074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.156269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1260/2518] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:46.157147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.167783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf413-82ef-4b05-8a49-7360fdec5cc8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.174156 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.174794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.175137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.175420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.176830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.179007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.215841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1259/2519] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:46.222154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.237882 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c79f7-5546-4d45-9640-f9b54d48e27a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.278129 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:46.343935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.346021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.346831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.347478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.348682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.352009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.390793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1261/2520] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:46 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:46.393436 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.408465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14161d-6440-486b-ab2a-cfbf0587391c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.415327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.416782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.417301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.417933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.419440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.421475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.441818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1260/2521] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:46.447944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.460510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba37a-fbdc-4151-9701-84c406bf5f3d admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.467110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.467745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.468042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.468313 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.469250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.471564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed9581-9ca3-4405-9955-35fd89c610a9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.485269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1262/2522] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:46.491404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.503351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd891c-b759-4dac-8562-5aecf4b40214 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.510873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.511146 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.511510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.512073 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] PATH_INFO: `/v3/projects/f5b16e2a0a534a9a9c4bd2bf79eb9ea8/users/99527fdc2d204bbe9ac12bb69f85bc7c/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.580997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b16e2a0a534a9a9c4bd2bf79eb9ea8, user_id=99527fdc2d204bbe9ac12bb69f85bc7c, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.587453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.623872 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1261/2523] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:46 2022] PUT /identity/v3/projects/f5b16e2a0a534a9a9c4bd2bf79eb9ea8/users/99527fdc2d204bbe9ac12bb69f85bc7c/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:46.635332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.635657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.635996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.687483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] MFA Rules not processed for user `99527fdc2d204bbe9ac12bb69f85bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:46.688819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:46.827049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1263/2524] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:46.832586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:46.950508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0b9e-17b4-4c32-b54f-5626697d3544 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:46.959230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:46.960327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:46.960885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:46.961680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:46.962580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:46.964623 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:46.998655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:47.009659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1262/2525] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:47.015728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.036309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bde0a-9589-43a7-9c0f-b1fd924dba25 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.136820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.138489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.138944 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.139486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.140544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.143328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.174173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1264/2526] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:47 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:47.182772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.206440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b385-3ab7-4b5a-a4a9-8603a6670548 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.214970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.216497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.216497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.216497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.217359 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.219171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.243905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1263/2527] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:47.248279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.260559 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7fc97-31cb-450e-a005-ddb0c9d03b40 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.269952 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.270901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.271197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.271549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] PATH_INFO: `/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a/users/ce95c8729ef2482eba397313cfc0bc11/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.289901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bbb1a068ff4605a41afbe3c28dec5a, user_id=ce95c8729ef2482eba397313cfc0bc11, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.293235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.310768 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:47.319426 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1265/2528] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:47 2022] PUT /identity/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a/users/ce95c8729ef2482eba397313cfc0bc11/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:47.325392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.339006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effb4a-1c13-4ca0-bb13-21bec9e02722 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.477572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.478393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.478501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.478770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.479418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.489809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a1dd-8662-4ca6-9cfc-bfedfb5eec80 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.499644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1264/2529] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:47.508137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.529564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be065b-43a7-4305-aeed-13bb7b9dc074 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.539625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.540330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.540614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.540895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] PATH_INFO: `/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a/users/ce95c8729ef2482eba397313cfc0bc11/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.542937 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bbb1a068ff4605a41afbe3c28dec5a, user_id=ce95c8729ef2482eba397313cfc0bc11, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.546328 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.564638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1266/2530] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:47 2022] PUT /identity/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a/users/ce95c8729ef2482eba397313cfc0bc11/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:47.582335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.582335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.582335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.624000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] MFA Rules not processed for user `ce95c8729ef2482eba397313cfc0bc11`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:47.625710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:47.756102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1265/2531] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:47.774213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:47.776701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:47.865863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a48d-80d9-4402-b304-4e704969e00b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:47.872402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:47.873474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:47.873703 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:47.874022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:47.886726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:47.889910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:47.902728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1267/2532] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:48.449338 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:48.460322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e60e-c218-4213-b2fc-a088439f84cf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:48.472159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce95c8729ef2482eba397313cfc0bc11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:48.473668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:48.474198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:48.474957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:48.476158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:48.476646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:48.485712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:48.503350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1266/2533] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:48.508741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:48.531143 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b77148-416d-4a6b-8d45-402ebf56d16c service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:48.539424 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce95c8729ef2482eba397313cfc0bc11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:48.540608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:48.541130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:48.541490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:48.542278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:48.564334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:48.618492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1268/2534] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:48 2022] POST /identity/v3/projects => generated 354 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:48.629798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:48.639732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d446d3-6164-4c3e-86b0-ba8ed51e7a6d tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:48.713992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:48.730258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce95c8729ef2482eba397313cfc0bc11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:48.731951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:48.732153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:48.732394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:48.733088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:48.733401 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:48.735887 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:48.749854 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1267/2535] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:48.796663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:48.808049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd18b-40bb-4f96-b749-e02c7285ad6c tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:48.815126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce95c8729ef2482eba397313cfc0bc11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:48.816293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:48.816293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:48.816293 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] PATH_INFO: `/v3/projects/722853f8914443c6bf8026ce83867fbc` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:48.817644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=722853f8914443c6bf8026ce83867fbc)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:48.819699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:48.874764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722853f8914443c6bf8026ce83867fbc', 'request_id': 'req-7e01edbd-6ecf-4014-ba7d-5108d574555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:48.882498 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722853f8914443c6bf8026ce83867fbc', 'request_id': 'req-7e01edbd-6ecf-4014-ba7d-5108d574555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:48.889026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722853f8914443c6bf8026ce83867fbc', 'request_id': 'req-7e01edbd-6ecf-4014-ba7d-5108d574555f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:48.903911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] The token cache is being invalidate because project 722853f8914443c6bf8026ce83867fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:48.904189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:48.904889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7e01edbd-6ecf-4014-ba7d-5108d574555f tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:48.906507 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1269/2536] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:48 2022] DELETE /identity/v3/projects/722853f8914443c6bf8026ce83867fbc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:49.147150 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:49.149305 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:49.227607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc1bd-7912-432b-878c-bd38eb5f23af tempest-VolumeQuotaClassesTest-750797224 tempest-VolumeQuotaClassesTest-750797224-project-admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:49.312717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:49.313387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:49.313677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:49.313987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] PATH_INFO: `/v3/users/99527fdc2d204bbe9ac12bb69f85bc7c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:49.315316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99527fdc2d204bbe9ac12bb69f85bc7c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:49.317316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:49.369488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99527fdc2d204bbe9ac12bb69f85bc7c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:49.370180 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99527fdc2d204bbe9ac12bb69f85bc7c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:49.386417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99527fdc2d204bbe9ac12bb69f85bc7c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:49.387533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99527fdc2d204bbe9ac12bb69f85bc7c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:49.398627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99527fdc2d204bbe9ac12bb69f85bc7c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:49.420331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1268/2537] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:49 2022] DELETE /identity/v3/users/99527fdc2d204bbe9ac12bb69f85bc7c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:49.425060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:49.425472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:49.425888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:49.452376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:49.453620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:49.513413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:49.539137 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1270/2538] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:49.554037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:49.555879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:49.586380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:49.636158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a09b-fd64-43fd-a8aa-f8b1b26d5317 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:49.641372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:49.642199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:49.642496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:49.642779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:49.653488 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:49.655062 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:49.666465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1269/2539] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:50.149272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:50.152007 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:50.171681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0b9eb-7a84-416d-9b3a-4e0a7fa9a8ab None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:50.176982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:50.177815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:50.178049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:50.178451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] PATH_INFO: `/v3/projects/f5b16e2a0a534a9a9c4bd2bf79eb9ea8` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:50.179673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b16e2a0a534a9a9c4bd2bf79eb9ea8)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:50.181602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:50.242094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b16e2a0a534a9a9c4bd2bf79eb9ea8', 'request_id': 'req-d647cb71-ea87-423b-a072-229c432ed168'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.250048 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b16e2a0a534a9a9c4bd2bf79eb9ea8', 'request_id': 'req-d647cb71-ea87-423b-a072-229c432ed168'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.256240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b16e2a0a534a9a9c4bd2bf79eb9ea8', 'request_id': 'req-d647cb71-ea87-423b-a072-229c432ed168'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.271282 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] The token cache is being invalidate because project f5b16e2a0a534a9a9c4bd2bf79eb9ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:50.271577 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.272227 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.273877 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1271/2540] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:50 2022] DELETE /identity/v3/projects/f5b16e2a0a534a9a9c4bd2bf79eb9ea8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:50.278242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:50.291708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08380f2-e021-481f-8c24-1c2c58d00d41 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:50.357703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:50.358373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:50.358652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:50.358925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] PATH_INFO: `/v3/users/ce95c8729ef2482eba397313cfc0bc11` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:50.360056 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce95c8729ef2482eba397313cfc0bc11)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:50.362065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:50.414609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce95c8729ef2482eba397313cfc0bc11'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.415315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce95c8729ef2482eba397313cfc0bc11'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.430358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce95c8729ef2482eba397313cfc0bc11'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.431814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce95c8729ef2482eba397313cfc0bc11'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.441312 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-fdfec47c-7341-4fdf-a0f5-bcb3d498b031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce95c8729ef2482eba397313cfc0bc11'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.458699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1270/2541] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:50 2022] DELETE /identity/v3/users/ce95c8729ef2482eba397313cfc0bc11 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:50.774696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:50.776236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:50.790767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647cb71-ea87-423b-a072-229c432ed168 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:50.876545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:50.877235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:50.877513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:50.877864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] PATH_INFO: `/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:50.879135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bbb1a068ff4605a41afbe3c28dec5a)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:50.881070 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:50.942145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'request_id': 'req-869bc772-1c39-481a-84e0-8df0bc7adde4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.949462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'request_id': 'req-869bc772-1c39-481a-84e0-8df0bc7adde4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.956607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bbb1a068ff4605a41afbe3c28dec5a', 'request_id': 'req-869bc772-1c39-481a-84e0-8df0bc7adde4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.973051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] The token cache is being invalidate because project a9bbb1a068ff4605a41afbe3c28dec5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:50.973346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.974112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-869bc772-1c39-481a-84e0-8df0bc7adde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:50.975637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1272/2542] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:50 2022] DELETE /identity/v3/projects/a9bbb1a068ff4605a41afbe3c28dec5a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:50.988751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:50.989292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:50.989555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.011364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:51.013174 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:51.052400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:51.085246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1271/2543] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:51.093165 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.093451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.093722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.105910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:51.126159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:51.127399 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:51.135701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1273/2544] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:58:51.141301 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.152115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478003-cad4-46b9-a8aa-32999467eb4e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.158417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.158910 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.159224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.159457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.160153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:58:51.160459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.162527 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.185741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1272/2545] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:58:51.190740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.200850 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc89fa-68b8-4e4e-b7b1-87e907421497 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.205894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.206514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.206794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.207065 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.207713 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.210272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.249241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1274/2546] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:51.255096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.267866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb21b-93d4-4bd9-9116-a3a0ae1e2835 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.343670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.344181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.344462 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.344736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.345379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.347411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.371760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1273/2547] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/users => generated 305 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:51.378331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.393680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8004-4cc9-477a-a4f1-e27afa04fd89 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.399410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.400040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.400322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.400599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.401256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.404409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.419515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1275/2548] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:51.424038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.435101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd29702-e7b5-44f5-ad4e-da418d7b44aa admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.440059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.440667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.440952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.441229 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.441905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.443535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd38d7-be01-4b6e-96af-447cd6e8e737 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.454589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1274/2549] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:51.459456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.472406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617096f7-dd9d-410a-a727-1cab603b0abe admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.477285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.478087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.478368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.478644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] PATH_INFO: `/v3/projects/3894fdb4964e4d58aa48fd4f365ea63b/users/557653e13587439194201abe420cf1bf/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.495555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3894fdb4964e4d58aa48fd4f365ea63b, user_id=557653e13587439194201abe420cf1bf, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.498956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.516217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1276/2550] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:51 2022] PUT /identity/v3/projects/3894fdb4964e4d58aa48fd4f365ea63b/users/557653e13587439194201abe420cf1bf/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:51.529032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.529397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.529794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.560828 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] MFA Rules not processed for user `557653e13587439194201abe420cf1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:51.562345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:51.650549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1275/2551] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:58:51.653128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.728054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ac31-9942-4549-b0de-05669e3d6b54 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.734052 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.734673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.734962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.735242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.735888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.737859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.772515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1277/2552] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:58:51.777352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.789821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a13b15-b115-4048-87c3-1006710140e1 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.828019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:51.859085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.859807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.860096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.860375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.861047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.863041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.888404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1276/2553] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:58:51 2022] POST /identity/v3/users => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:58:51.893365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.910476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff7c8b-a740-4177-b4d6-80cf5b24dda0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.916735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.917581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.917708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.918003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.919439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.921531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.937487 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1278/2554] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:51.941530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:51.953923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cc1c-ccea-4741-9394-935a8fbd78c0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:51.959999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:51.960794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:51.961085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:51.961495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] PATH_INFO: `/v3/projects/815253928ff94f84bb0ce2649c6815f9/users/7e352641eac14a81aefdb43f51423ee8/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:51.980666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815253928ff94f84bb0ce2649c6815f9, user_id=7e352641eac14a81aefdb43f51423ee8, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:51.984025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:51.999916 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1277/2555] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:51 2022] PUT /identity/v3/projects/815253928ff94f84bb0ce2649c6815f9/users/7e352641eac14a81aefdb43f51423ee8/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:52.004659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:52.018263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a0107-d740-49e3-946a-d9342668a6ce admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:52.095732 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:52.096438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:52.096797 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:52.097144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:52.097910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:52.100892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179249c-fa9f-4e23-9a5f-e4de74cd57ed admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:52.112327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1279/2556] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:58:52.117005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:52.132929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d4d01-8008-4498-ac54-5fe42be652f9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:52.140513 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:52.141669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:52.143295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:52.143295 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] PATH_INFO: `/v3/projects/815253928ff94f84bb0ce2649c6815f9/users/7e352641eac14a81aefdb43f51423ee8/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:52.146805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=815253928ff94f84bb0ce2649c6815f9, user_id=7e352641eac14a81aefdb43f51423ee8, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:52.150703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:52.173879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1278/2557] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:58:52 2022] PUT /identity/v3/projects/815253928ff94f84bb0ce2649c6815f9/users/7e352641eac14a81aefdb43f51423ee8/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:52.186188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:52.186188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:52.186188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:52.207530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:52.221955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] MFA Rules not processed for user `7e352641eac14a81aefdb43f51423ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:52.223224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:52.318388 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1280/2558] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:52.329930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:52.331893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:52.429648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cba87-ffb2-4d26-b8e2-29a9b117c56e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:52.435574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:52.436227 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:52.436510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:52.436791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:52.449964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:52.452287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df22273-23aa-4936-9cbf-6446e4289b15 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:52.466336 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1279/2559] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:52 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:52.687122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:52.703265 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdc4c4-08d6-443f-972b-dd53455eb9b7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:52.709513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:52.710544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:52.711001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:52.711450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:52.804297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:52.805916 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:52.816934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1281/2560] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:58:55.620425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:55.620929 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:55.621055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:55.642536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:55.643778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:55.729847 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1280/2561] 10.222.0.61 () {58 vars in 1009 bytes} [Wed Aug 24 05:58:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:55.761953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:55.764309 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:55.875867 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2c31-b374-45f2-8988-46d09853d0fa service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:55.883149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:55.883871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:55.884343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:55.884816 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:55.899270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:55.906981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fa2cd-e89b-4a8a-b7e3-596269b8da82 service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:55.917124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1282/2562] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:58:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:58:58.443308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:58.522222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:58.571138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476770-f453-4f14-94bd-438ab5e8e524 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:58.577052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:58.577703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:58.578084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:58.578361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] PATH_INFO: `/v3/users/557653e13587439194201abe420cf1bf` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:58.579509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] RBAC: Authorizing `identity:delete_user(user_id=557653e13587439194201abe420cf1bf)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:58.581579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:58.649814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557653e13587439194201abe420cf1bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:58.650563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557653e13587439194201abe420cf1bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:58.663925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557653e13587439194201abe420cf1bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:58.664646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557653e13587439194201abe420cf1bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:58.673676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557653e13587439194201abe420cf1bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:58.702495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1281/2563] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:58 2022] DELETE /identity/v3/users/557653e13587439194201abe420cf1bf => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:58:58.704267 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:58.704760 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:58.704913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:58.743807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:58:58.745822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:58.799142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:58.869326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1283/2564] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:58:58.891928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:58.895753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:59.011831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79e47-88ec-4e4b-978d-a6b460f1682a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:59.017240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:59.017682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:59.017977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:59.019490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:59.032751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:59.034479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:59.046998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1282/2565] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:58:59.472967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:59.475376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:58:59.509707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82931d-3c9d-4a1e-9c71-fb3b0327c496 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:59.520718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:59.521685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:59.522254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:59.522720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] PATH_INFO: `/v3/projects/3894fdb4964e4d58aa48fd4f365ea63b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:59.524942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3894fdb4964e4d58aa48fd4f365ea63b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:59.527121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:59.621320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3894fdb4964e4d58aa48fd4f365ea63b', 'request_id': 'req-13b574d1-b366-437d-87f0-57a460e19783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.630563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3894fdb4964e4d58aa48fd4f365ea63b', 'request_id': 'req-13b574d1-b366-437d-87f0-57a460e19783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.641522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3894fdb4964e4d58aa48fd4f365ea63b', 'request_id': 'req-13b574d1-b366-437d-87f0-57a460e19783'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.656434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] The token cache is being invalidate because project 3894fdb4964e4d58aa48fd4f365ea63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:58:59.656853 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.657595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.662715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1284/2566] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:58:59 2022] DELETE /identity/v3/projects/3894fdb4964e4d58aa48fd4f365ea63b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:58:59.663700 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:58:59.674510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab23e-3e82-479c-ab80-4cddcabe126c service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:58:59.738745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:59.747524 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:58:59.748266 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:58:59.748684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:58:59.749093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] PATH_INFO: `/v3/users/7e352641eac14a81aefdb43f51423ee8` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:58:59.750484 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e352641eac14a81aefdb43f51423ee8)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:58:59.753066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:58:59.836254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e352641eac14a81aefdb43f51423ee8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.836951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e352641eac14a81aefdb43f51423ee8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.852110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e352641eac14a81aefdb43f51423ee8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.853027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e352641eac14a81aefdb43f51423ee8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.872960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-196f5b7e-a156-4927-bd7f-f72115d98f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e352641eac14a81aefdb43f51423ee8'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:58:59.921196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1283/2567] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:58:59 2022] DELETE /identity/v3/users/7e352641eac14a81aefdb43f51423ee8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:00.736406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:00.738686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:00.758549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b574d1-b366-437d-87f0-57a460e19783 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:00.866348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:00.867110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:00.867472 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:00.867864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] PATH_INFO: `/v3/projects/815253928ff94f84bb0ce2649c6815f9` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:00.869531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815253928ff94f84bb0ce2649c6815f9)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:00.871572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:00.945497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:00.947751 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815253928ff94f84bb0ce2649c6815f9', 'request_id': 'req-fa196b4b-c860-4050-b634-dc3c91f631a8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:00.955209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815253928ff94f84bb0ce2649c6815f9', 'request_id': 'req-fa196b4b-c860-4050-b634-dc3c91f631a8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:00.969518 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815253928ff94f84bb0ce2649c6815f9', 'request_id': 'req-fa196b4b-c860-4050-b634-dc3c91f631a8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:00.988191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] The token cache is being invalidate because project 815253928ff94f84bb0ce2649c6815f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:00.988519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:00.989270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fa196b4b-c860-4050-b634-dc3c91f631a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:00.997548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1285/2568] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:00 2022] DELETE /identity/v3/projects/815253928ff94f84bb0ce2649c6815f9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:00.999004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.000176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.000875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.039161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:01.041377 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:01.162012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1284/2569] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:01.171286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994278-fccf-45e2-a531-7af6040435cb None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.171827 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994278-fccf-45e2-a531-7af6040435cb None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.172233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994278-fccf-45e2-a531-7af6040435cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.202060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-62994278-fccf-45e2-a531-7af6040435cb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:01.205557 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-62994278-fccf-45e2-a531-7af6040435cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:01.219630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1286/2570] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:01.224672 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.243965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce90252-89af-42e8-af0b-9a7c80455db5 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.254618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.255570 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.255899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.256126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.256810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:01.257121 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.258890 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.274008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1285/2571] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:01.279041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62994278-fccf-45e2-a531-7af6040435cb None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.292567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62994278-fccf-45e2-a531-7af6040435cb None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.298694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.299334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.299650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.299902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.300545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.302613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.334083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1287/2572] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:01 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:01.339459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.350210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33841-635f-4b01-bb10-13ab3acb9670 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.444138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.444800 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.445086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.445368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.446063 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.448021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.461425 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:01.484572 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1286/2573] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:01 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:01.489221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.500681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dda5a9-02cc-4d6b-9ec1-5fc827e1485e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.505811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.506429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.506718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.507000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.507659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.509287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.521805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1288/2574] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:01.528209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.559977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fe2c5-5e05-4494-9346-66d696e3c8a1 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.565873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.566973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.566973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.567167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.567779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.569478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133e3a3-b30d-4177-82fa-5acefda49f89 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.585287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1287/2575] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:01.586439 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:01.597050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972aab-d23d-4721-b07f-6692979b0779 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:01.602026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:01.602692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.602972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.603249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] PATH_INFO: `/v3/projects/026b26ab2be04ab88fb229f387ef0a16/users/7603036039244d7f89e5cb14b45ad1f4/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.631047 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026b26ab2be04ab88fb229f387ef0a16, user_id=7603036039244d7f89e5cb14b45ad1f4, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:01.637547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:01.665924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1289/2576] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:01 2022] PUT /identity/v3/projects/026b26ab2be04ab88fb229f387ef0a16/users/7603036039244d7f89e5cb14b45ad1f4/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:01.762048 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0329-51ff-4b23-8576-3e376864be01 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:01.763047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0329-51ff-4b23-8576-3e376864be01 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:01.763538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0329-51ff-4b23-8576-3e376864be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:01.864626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-790c0329-51ff-4b23-8576-3e376864be01 None None] MFA Rules not processed for user `7603036039244d7f89e5cb14b45ad1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:01.870965 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-790c0329-51ff-4b23-8576-3e376864be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:01.990680 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1288/2577] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:02.002465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:02.004473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:02.081245 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536b05-a12c-4ed8-a667-9a6cc0ff2d38 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:02.086280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff470a005324829a2d9ada970436094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:02.086955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:02.087268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:02.087654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:02.103216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:02.105446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:02.120192 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1290/2578] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:11.976067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:12.113154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:12.534000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:12.534487 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:12.534919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:12.572943 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:12.578642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:12.668778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1289/2579] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 05:59:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:12.688754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:12.690691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:12.805170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417bbc7-f4f1-4a16-8610-62227a1066e3 service glance] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:12.811855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:12.812522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:12.813272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:12.813422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:12.828422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:12.833886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fe9d0-812f-4164-8cbb-d5899406c723 service swift] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:12.846544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1291/2580] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 05:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:59:20.209648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:20.317277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5931b1-8c2d-4ea0-bdee-8191656b364f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:20.324520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:20.326493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:20.327838 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:20.328130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] PATH_INFO: `/v3/users/7603036039244d7f89e5cb14b45ad1f4` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:20.331120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7603036039244d7f89e5cb14b45ad1f4)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:20.339920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:20.409365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7603036039244d7f89e5cb14b45ad1f4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:20.410084 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7603036039244d7f89e5cb14b45ad1f4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:20.432171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7603036039244d7f89e5cb14b45ad1f4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:20.433112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7603036039244d7f89e5cb14b45ad1f4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:20.446190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7603036039244d7f89e5cb14b45ad1f4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:20.466994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1290/2581] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:20 2022] DELETE /identity/v3/users/7603036039244d7f89e5cb14b45ad1f4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:20.471802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:20.472558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:20.472558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:20.495480 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:20.496790 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:20.607054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1292/2582] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:20.623200 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:20.625699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:20.687256 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:20.750720 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41eec-b81b-4c24-93c9-7338b4e27816 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:20.756468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:20.757308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:20.757597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:20.757907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:20.770209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:20.771850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9510b7-f03c-4ac5-b0e2-dfd3e32e3151 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:20.794746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1291/2583] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:21.307240 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.308290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:21.338871 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9c9a-2246-4565-b9a2-b4a5d205b8f4 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.347320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.348104 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.349448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.349561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] PATH_INFO: `/v3/projects/026b26ab2be04ab88fb229f387ef0a16` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.350956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026b26ab2be04ab88fb229f387ef0a16)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.352880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.469156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026b26ab2be04ab88fb229f387ef0a16', 'request_id': 'req-95cc9e0d-651a-4630-a432-dc80aa8b4d93'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:21.477408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026b26ab2be04ab88fb229f387ef0a16', 'request_id': 'req-95cc9e0d-651a-4630-a432-dc80aa8b4d93'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:21.485848 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026b26ab2be04ab88fb229f387ef0a16', 'request_id': 'req-95cc9e0d-651a-4630-a432-dc80aa8b4d93'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:21.501512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] The token cache is being invalidate because project 026b26ab2be04ab88fb229f387ef0a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:21.501811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:21.502743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-95cc9e0d-651a-4630-a432-dc80aa8b4d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:21.504470 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1293/2584] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:21 2022] DELETE /identity/v3/projects/026b26ab2be04ab88fb229f387ef0a16 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:21.515437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.516002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.516951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.545386 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:21.546793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:21.640757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1292/2585] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:21.650002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.650244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.650630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.680182 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:21.682174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:21.692828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1294/2586] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:21.697550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.709250 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759795d3-36ed-43f2-b554-16b44146ea57 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.715323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.715953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.716246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.716523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.717203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:21.717498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.719160 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.732583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1293/2587] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:21.737938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.754124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf408-dacb-424b-807d-ffe76f95ec2f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.762747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.764257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.764257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.764257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.764948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.767001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.771947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:21.803726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1295/2588] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:21 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:21.808827 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.822747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517d82-e6fb-465f-b59c-47d1de75cf3b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.887496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.888136 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.888418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.888694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.889318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.891378 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.914058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1294/2589] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:21 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:21.918229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.929189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9f5f6-906f-42c6-8dcd-4951c18e2644 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.934675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.935327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.935620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.936142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.936822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.938759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.954719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1296/2590] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:21.955956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:21.967479 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43d3a-fac6-4119-839e-96d6e1ccfbce admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:21.972372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:21.973004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:21.973303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:21.973598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:21.974325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:21.976636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bfe8e-014b-44c1-8540-29f182d3f972 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:21.989816 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1295/2591] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:21.992214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:22.003004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a81a-4f89-4db8-b895-7105a479fa7a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:22.008171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:22.008847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:22.009128 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:22.009409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] PATH_INFO: `/v3/projects/deb4f7270e734a2fbe65ab1657939722/users/d66c3ed8539342e88c25ba1dc1010099/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:22.026201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb4f7270e734a2fbe65ab1657939722, user_id=d66c3ed8539342e88c25ba1dc1010099, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:22.029029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:22.046618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1297/2592] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:21 2022] PUT /identity/v3/projects/deb4f7270e734a2fbe65ab1657939722/users/d66c3ed8539342e88c25ba1dc1010099/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:22.058626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:22.058997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:22.059277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:22.094230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] MFA Rules not processed for user `d66c3ed8539342e88c25ba1dc1010099`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:22.095742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:22.118102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:22.167997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1296/2593] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:22.181753 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:22.184069 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:22.253131 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c180f-3459-4973-a30f-7be1f8e473a1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:22.257747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:22.258408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:22.258696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:22.259004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:22.268939 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:22.270499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:22.288819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1298/2594] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:25.239279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:25.241685 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:25.317782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b3d83-7c07-4e9f-a2c3-a6d53dca99ec None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:25.321702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:25.322351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:25.322635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:25.322909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:25.325243 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:25.392956 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:25.394330 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:25.405132 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1297/2595] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:29.054028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.055671 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:29.137255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.139067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:29.155308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155cb9-b9f5-428f-82e2-b46662a307c8 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:29.163651 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:29.164326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.164637 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.164957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] PATH_INFO: `/v3/users/74a53d36cb7549479e0d4692ffde1f9e` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.168658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a53d36cb7549479e0d4692ffde1f9e)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:29.171739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:29.251145 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554da89-33b5-418f-a101-750dc8dcc1c8 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:29.253081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a53d36cb7549479e0d4692ffde1f9e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.255058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a53d36cb7549479e0d4692ffde1f9e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.259617 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5127-f417-4071-be24-d706963100bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:29.260612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5127-f417-4071-be24-d706963100bb service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.261099 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5127-f417-4071-be24-d706963100bb service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.261815 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5127-f417-4071-be24-d706963100bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.265146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-82cd5127-f417-4071-be24-d706963100bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:29.279913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a53d36cb7549479e0d4692ffde1f9e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.281011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a53d36cb7549479e0d4692ffde1f9e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.281342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5127-f417-4071-be24-d706963100bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:29.283419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5127-f417-4071-be24-d706963100bb service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:29.287641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:29.297746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-53eaac07-2386-406b-88c9-c8d5d515e4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a53d36cb7549479e0d4692ffde1f9e'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.302016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1299/2596] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:29.318317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1298/2597] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:29 2022] DELETE /identity/v3/users/74a53d36cb7549479e0d4692ffde1f9e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:29.535295 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5127-f417-4071-be24-d706963100bb service placement] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.546747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5127-f417-4071-be24-d706963100bb service placement] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:29.603672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:29.620550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:29.621200 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.621482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.621782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] PATH_INFO: `/v3/projects/6be0774a8ec04aa7aec1fa638038c7fd` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.623112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be0774a8ec04aa7aec1fa638038c7fd)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:29.625250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:29.673972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be0774a8ec04aa7aec1fa638038c7fd', 'request_id': 'req-871f2f07-fc07-46e1-9d32-a509ac54d31f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.682924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be0774a8ec04aa7aec1fa638038c7fd', 'request_id': 'req-871f2f07-fc07-46e1-9d32-a509ac54d31f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.689151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be0774a8ec04aa7aec1fa638038c7fd', 'request_id': 'req-871f2f07-fc07-46e1-9d32-a509ac54d31f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.703207 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] The token cache is being invalidate because project 6be0774a8ec04aa7aec1fa638038c7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:29.703494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.704116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-871f2f07-fc07-46e1-9d32-a509ac54d31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:29.705607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1300/2598] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:29 2022] DELETE /identity/v3/projects/6be0774a8ec04aa7aec1fa638038c7fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:29.710501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.710818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.711119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.732141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:29.733391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:29.793523 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1299/2599] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:29.802644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.802934 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.803220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.824149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:29.825358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:29.834327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1301/2600] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:29.840110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.856693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d351-ae22-4d06-aa6a-0d0410cc6344 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:29.862661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:29.863244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.863526 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.863797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.864447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:29.864750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:29.866368 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:29.878785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1300/2601] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:29.883466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.893514 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1db4-2d27-43bd-bab4-642b4f82cdd5 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:29.898794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:29.899409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:29.899731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:29.900195 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:29.900878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:29.903554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:29.931581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1302/2602] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:29 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:29.937303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:29.947643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77291191-0d88-4c56-9988-85064bcb9f3b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.006957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.007571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.007857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.008133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.008785 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.011315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.033072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1301/2603] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:29 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:30.037340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.048060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c655-e05a-4956-b9c4-16c9eec462ed admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.052642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.053252 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.053541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.053855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.054510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.056160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.067605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1303/2604] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:30.071853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.082757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856907-c540-4662-a5f5-0aff34a1d0f7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.087344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.087946 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.088230 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.088508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.089162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.090770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921de0-42d0-4073-8bcd-ad8a7ce8ff1b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.101869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1302/2605] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:30.109176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.119545 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cdf08-6951-478e-8403-68532aa29ffc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.125085 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.125743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.126071 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.126353 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] PATH_INFO: `/v3/projects/bf377299126a419a9d163019948d3d46/users/0068ab40e4e94aabafce1e3f900f5dd2/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.142568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf377299126a419a9d163019948d3d46, user_id=0068ab40e4e94aabafce1e3f900f5dd2, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.145221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.159887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1304/2606] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:30 2022] PUT /identity/v3/projects/bf377299126a419a9d163019948d3d46/users/0068ab40e4e94aabafce1e3f900f5dd2/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:30.170482 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.171026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.171026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.206530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] MFA Rules not processed for user `0068ab40e4e94aabafce1e3f900f5dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:30.207817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.269067 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:30.300855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1303/2607] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:30.305513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.378788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f709a-983b-471e-8ee9-44780c3cb748 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.384117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.384748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.385041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.385320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.386543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.388716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.406940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:30.424173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1305/2608] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:30.428434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.440002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52ea31-032d-4cfe-8c07-052fbec9fb39 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.516480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.517249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.517610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.517985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.518725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.520711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.557986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1304/2609] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:30.560416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.578075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9827058-a4c5-4e03-abff-85313583d200 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.583194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.583895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.584375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.584734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.585547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.587663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.601317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1306/2610] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:30.605373 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.622034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d12fb6-48a9-4d31-8e0a-a3f871bd1acb admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.630648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.631100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.631470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.631841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] PATH_INFO: `/v3/projects/cfca687fc4b5483f94b6ae803756c84a/users/bcc5dcd582324e779e285c3ea986043b/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.654381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfca687fc4b5483f94b6ae803756c84a, user_id=bcc5dcd582324e779e285c3ea986043b, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.658811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.674903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1305/2611] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:30 2022] PUT /identity/v3/projects/cfca687fc4b5483f94b6ae803756c84a/users/bcc5dcd582324e779e285c3ea986043b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:30.679781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.692010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e85b0-77fe-4512-b6b5-0c684e65d7be admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.770204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.770940 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.771444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.771880 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.773109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.775808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e8590-59ec-4333-a329-fc4060cb069b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.791435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1307/2612] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:30.796383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.808184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7d9-954b-4672-8e94-f8b34000032e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.813239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.813957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.814241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.814522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] PATH_INFO: `/v3/projects/cfca687fc4b5483f94b6ae803756c84a/users/bcc5dcd582324e779e285c3ea986043b/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.816499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfca687fc4b5483f94b6ae803756c84a, user_id=bcc5dcd582324e779e285c3ea986043b, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.819213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.830862 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1306/2613] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:30 2022] PUT /identity/v3/projects/cfca687fc4b5483f94b6ae803756c84a/users/bcc5dcd582324e779e285c3ea986043b/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:30.846849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.847170 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.847452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.887862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] MFA Rules not processed for user `bcc5dcd582324e779e285c3ea986043b`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:30.889117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.973837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1308/2614] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:30.990339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.992357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:31.066892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e9f3-9302-46e0-9298-ebcf7907960b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:31.070489 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:31.071134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.071417 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.071753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.080884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:31.082387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:31.091960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1307/2615] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:59:31.170958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:31.181347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0f7a-2f3a-4c73-87c6-e9caebcbe503 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:31.186469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:31.187118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.187438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.187995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.249658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:31.251218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5f6d-9a70-4512-a36d-9dba8418fb50 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:31.260445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1309/2616] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:59:34.043382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.083106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:34.108839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e18b0-d22d-484b-b6fb-f97b85ac9999 service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.113679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:34.114339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.114618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.114892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] PATH_INFO: `/v3/users/0068ab40e4e94aabafce1e3f900f5dd2` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.116106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0068ab40e4e94aabafce1e3f900f5dd2)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:34.118043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:34.168633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0068ab40e4e94aabafce1e3f900f5dd2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.169291 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0068ab40e4e94aabafce1e3f900f5dd2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.182034 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0068ab40e4e94aabafce1e3f900f5dd2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.183267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0068ab40e4e94aabafce1e3f900f5dd2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.191690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0068ab40e4e94aabafce1e3f900f5dd2'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.204817 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1308/2617] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:34 2022] DELETE /identity/v3/users/0068ab40e4e94aabafce1e3f900f5dd2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:34.209335 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.209855 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.209973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.217060 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:34.233003 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:34.234650 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.342702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1310/2618] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:34.353222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.355656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.385080 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.386645 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.398864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755683af-06d3-4c5a-b929-6b7510fe024a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.404199 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:34.404932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.405307 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.405661 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] PATH_INFO: `/v3/users/d66c3ed8539342e88c25ba1dc1010099` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.406955 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66c3ed8539342e88c25ba1dc1010099)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:34.409051 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:34.433948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a755-f17a-49e7-b58e-fce21c1824e7 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.438224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:34.438884 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.439164 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.439468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.451051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:34.452639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989e36a-ba40-4354-ab35-fc86b886a5e2 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:34.463919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1309/2619] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:34.468968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66c3ed8539342e88c25ba1dc1010099'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.470029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66c3ed8539342e88c25ba1dc1010099'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.470624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66c3ed8539342e88c25ba1dc1010099'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.488041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66c3ed8539342e88c25ba1dc1010099'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.496953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66c3ed8539342e88c25ba1dc1010099'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.512390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1311/2620] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:34 2022] DELETE /identity/v3/users/d66c3ed8539342e88c25ba1dc1010099 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:34.517891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.518460 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.518888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.545518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:34.546643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.618727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:34.635392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1310/2621] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:34.645130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.646568 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.718980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4636ce-17da-45f0-b6b7-8056e093baba admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.723377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:34.724097 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.724481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.724860 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.735560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:34.737025 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:34.747551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1312/2622] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:34.781712 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.785165 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:34.801358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50fc11-2a12-4418-8e54-7831ce92bcfe None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.807293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:34.807809 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:34.808100 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:34.808726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] PATH_INFO: `/v3/projects/bf377299126a419a9d163019948d3d46` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:34.809859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf377299126a419a9d163019948d3d46)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:34.812193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:34.872348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf377299126a419a9d163019948d3d46', 'request_id': 'req-ec6c33ce-292a-4994-a419-f3aa5af087bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.880723 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf377299126a419a9d163019948d3d46', 'request_id': 'req-ec6c33ce-292a-4994-a419-f3aa5af087bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.888728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf377299126a419a9d163019948d3d46', 'request_id': 'req-ec6c33ce-292a-4994-a419-f3aa5af087bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.905975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] The token cache is being invalidate because project bf377299126a419a9d163019948d3d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:34.906351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.907027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:34.908586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1311/2623] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:34 2022] DELETE /identity/v3/projects/bf377299126a419a9d163019948d3d46 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:34.912953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:34.930054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b06e-2b3f-4372-988a-5e08da2129de service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:34.948376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:35.016356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.017002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.017286 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.017573 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] PATH_INFO: `/v3/users/bcc5dcd582324e779e285c3ea986043b` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.018836 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc5dcd582324e779e285c3ea986043b)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.020811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.051798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.053821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.074932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33ce-292a-4994-a419-f3aa5af087bf admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.081530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.082414 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.082764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.083262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] PATH_INFO: `/v3/projects/deb4f7270e734a2fbe65ab1657939722` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.084530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb4f7270e734a2fbe65ab1657939722)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.086586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.092172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc5dcd582324e779e285c3ea986043b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.092947 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc5dcd582324e779e285c3ea986043b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.093562 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc5dcd582324e779e285c3ea986043b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.106873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc5dcd582324e779e285c3ea986043b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.116091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a6fede07-6b7d-4a70-9a8d-636295c5b34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc5dcd582324e779e285c3ea986043b'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.129715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1313/2624] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:34 2022] DELETE /identity/v3/users/bcc5dcd582324e779e285c3ea986043b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:35.139199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb4f7270e734a2fbe65ab1657939722', 'request_id': 'req-6841046c-c55e-4bb5-9af2-8b55673e5fe3'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.148029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb4f7270e734a2fbe65ab1657939722', 'request_id': 'req-6841046c-c55e-4bb5-9af2-8b55673e5fe3'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.155438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb4f7270e734a2fbe65ab1657939722', 'request_id': 'req-6841046c-c55e-4bb5-9af2-8b55673e5fe3'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.168043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] The token cache is being invalidate because project deb4f7270e734a2fbe65ab1657939722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:35.168497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.169176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6841046c-c55e-4bb5-9af2-8b55673e5fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.171576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1312/2625] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:35 2022] DELETE /identity/v3/projects/deb4f7270e734a2fbe65ab1657939722 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:35.177299 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.177592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.178136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.201342 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:35.202986 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.267758 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1314/2626] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:35.276756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.277171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.277522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.301117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:35.302405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.311870 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1313/2627] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:35.316241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.326724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb4e4-5bbe-4c25-b121-eb29fe5cb03a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.333854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.334624 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.334962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.335243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.335933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:35.336239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.337936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.354476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1315/2628] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:35.355696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.365590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2db98-adbe-4b7d-8c63-a471e7a110cb None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.371393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.372032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.372319 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.372611 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.373240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.375189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.414345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1314/2629] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:35.416162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.427589 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4a040-5d12-43b4-8b8f-5aa04c1930fe admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.431261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.433654 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.458032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:35.484198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:35.510046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.511348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.511637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.511913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.512564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.514593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.516992 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5206f9b-fadc-40d1-a736-73bdc5a34947 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.521880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.522512 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.522798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.523076 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] PATH_INFO: `/v3/projects/cfca687fc4b5483f94b6ae803756c84a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.524446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfca687fc4b5483f94b6ae803756c84a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.526232 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.544590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1316/2630] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:35.546254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.556818 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7aa87-a96a-478b-a856-745f46272f5a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.563196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.563814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.564264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.564553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.565214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.567403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.581332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1317/2631] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:35.585715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.588907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfca687fc4b5483f94b6ae803756c84a', 'request_id': 'req-5ccec167-883e-4df2-8ab8-01cb6e345226'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.598032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfca687fc4b5483f94b6ae803756c84a', 'request_id': 'req-5ccec167-883e-4df2-8ab8-01cb6e345226'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.598685 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e67866-9ef8-4a70-aab1-6ddb676ed370 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.605049 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfca687fc4b5483f94b6ae803756c84a', 'request_id': 'req-5ccec167-883e-4df2-8ab8-01cb6e345226'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.616574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] The token cache is being invalidate because project cfca687fc4b5483f94b6ae803756c84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:35.616865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.617649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5ccec167-883e-4df2-8ab8-01cb6e345226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:35.619158 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1315/2632] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:35 2022] DELETE /identity/v3/projects/cfca687fc4b5483f94b6ae803756c84a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:35.626770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec646-e74f-4777-9c49-e43f48640c9a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.627055 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec646-e74f-4777-9c49-e43f48640c9a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.627331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec646-e74f-4777-9c49-e43f48640c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.649351 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-517ec646-e74f-4777-9c49-e43f48640c9a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:35.650644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-517ec646-e74f-4777-9c49-e43f48640c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.670993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.671614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.671898 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.672175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.672828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.674492 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.685347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1318/2633] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:35.689590 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.691348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.704597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f51ec-2f1c-4fea-b060-5a77d9121ca3 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.709466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.710162 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.710451 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.710727 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] PATH_INFO: `/v3/projects/99013171fca243cda0c0bc4384f25c5c/users/174e46c026084161a72a73f5e3355089/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.720102 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1316/2634] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:35.727821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=99013171fca243cda0c0bc4384f25c5c, user_id=174e46c026084161a72a73f5e3355089, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.728729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.729199 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.729648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.733167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c876882-b6ca-43ee-b4c8-f07ee8b045bd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.749859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1319/2635] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:35 2022] PUT /identity/v3/projects/99013171fca243cda0c0bc4384f25c5c/users/174e46c026084161a72a73f5e3355089/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:35.755061 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:35.756473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.761036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.761257 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.761540 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.799508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] MFA Rules not processed for user `174e46c026084161a72a73f5e3355089`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:35.800747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.819718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1317/2636] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:35.824516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.835284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8daf-2c50-4568-905a-be81f92d23b2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.840724 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.841345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.841631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.842019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.842962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:35.843311 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.845182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.847043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:35.870350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1318/2637] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:59:35.876065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.879235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1320/2638] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:35.887529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e86b-8735-4b80-bcc6-126aff13b79d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:35.890964 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.892446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:35.892586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:35.893057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:35.893346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:35.893627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:35.894675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:35.896217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:35.904178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:35.925615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1319/2639] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:35.929952 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:35.968175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c54f-2531-4dd0-aa75-44d6b82c1816 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.000242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbac0-55b4-40c2-b14b-169427c0fae5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.005006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.005639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.005983 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.006260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.006886 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.008810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.020820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.021385 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.021679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.022001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.032564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1320/2640] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:35 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:36.036273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.046090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffc0a5-b3d4-4046-9a80-74fdbca6d710 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.050911 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.051514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.051842 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.053101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.053101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.054278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.066246 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1321/2641] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:36.070224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.081503 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa3435-0b95-4653-9757-a082b84878f8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.087012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.087795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.088231 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.088642 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.089605 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.091443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.096673 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.098155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6e94-1fb4-4e7b-bfc1-ce8fdf20b6f5 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.103206 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1322/2642] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:36.107358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.109668 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1321/2643] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:59:36.117190 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b024c1-ae81-429b-bed8-109af266fee3 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.122652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.123480 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.123772 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.124058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] PATH_INFO: `/v3/projects/b125140776ad40b0954523baaf443ade/users/b9ed0cd94ec14107858f91ff29e82e7f/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.142283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b125140776ad40b0954523baaf443ade, user_id=b9ed0cd94ec14107858f91ff29e82e7f, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.144954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.159443 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1323/2644] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:36 2022] PUT /identity/v3/projects/b125140776ad40b0954523baaf443ade/users/b9ed0cd94ec14107858f91ff29e82e7f/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:36.171442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.171729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.172001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.206111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] MFA Rules not processed for user `b9ed0cd94ec14107858f91ff29e82e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:36.207345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:36.298615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1322/2645] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:36.303195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.376072 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09b8f-194b-4117-ad91-a534b3a24926 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.380845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.381455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.381747 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.382201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.382753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.384658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.408207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:36.418586 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1324/2646] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:36 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:36.419814 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.427416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=100 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:36.432752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33efd56-9ac8-445e-88a1-96b71ec768be None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.530640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.531497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.531893 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.532288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.533377 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.535804 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.581455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1323/2647] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:36 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:36.583029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.597490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723ff21-0933-4f1d-8ff3-118fe841835b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.605298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.606001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.606292 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.606577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.607261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.608921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.622408 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1325/2648] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:36.626878 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.638523 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae194e7-4793-4995-8f79-3559e6cf7537 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.644220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.644933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.645233 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.645512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] PATH_INFO: `/v3/projects/391a793ed6a547ada710bca54307bf91/users/0d331a8afc2244a0bdb3b1e88e394392/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.666769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391a793ed6a547ada710bca54307bf91, user_id=0d331a8afc2244a0bdb3b1e88e394392, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.670318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.698502 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1324/2649] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:36 2022] PUT /identity/v3/projects/391a793ed6a547ada710bca54307bf91/users/0d331a8afc2244a0bdb3b1e88e394392/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:36.704662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.722694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea832e-a798-417d-a961-6ad10067fb12 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.804277 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.804907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.805195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.805474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.806175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.808468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e7db3-ad26-4366-a0e3-6b1caea5093b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.820322 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1326/2650] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:36.825943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.838601 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f56b-cb68-45f7-92b2-08a238b979b4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.844169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.844967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.845258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.845609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] PATH_INFO: `/v3/projects/391a793ed6a547ada710bca54307bf91/users/0d331a8afc2244a0bdb3b1e88e394392/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.847631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391a793ed6a547ada710bca54307bf91, user_id=0d331a8afc2244a0bdb3b1e88e394392, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.850368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.861481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1325/2651] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:36 2022] PUT /identity/v3/projects/391a793ed6a547ada710bca54307bf91/users/0d331a8afc2244a0bdb3b1e88e394392/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:36.873798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.874117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.874362 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.903601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] MFA Rules not processed for user `0d331a8afc2244a0bdb3b1e88e394392`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:36.905332 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:36.987617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1327/2652] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:36.999619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.001323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:37.064731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70091124-4846-40c9-8e72-418a76f3a260 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.068581 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.069204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.069530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.069842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.079739 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.081194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.091216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1326/2653] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:37.140364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.154951 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fbfc-df50-4c21-b6c5-fde25af1527d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.160626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.161601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.162128 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.162595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.233954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.235406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fcf29-542b-441a-82d6-3de4bc19e2f9 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.245475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1328/2654] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:40.698261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:40.767830 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4648a38-8efd-452a-a0e4-9af5bf65ee1e service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:40.775219 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:40.776757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:40.777243 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:40.777724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] PATH_INFO: `/v3/users/b9ed0cd94ec14107858f91ff29e82e7f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:40.779605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ed0cd94ec14107858f91ff29e82e7f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:40.783333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:40.787493 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:40.847347 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ed0cd94ec14107858f91ff29e82e7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:40.848014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ed0cd94ec14107858f91ff29e82e7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:40.848630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ed0cd94ec14107858f91ff29e82e7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:40.861491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ed0cd94ec14107858f91ff29e82e7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:40.870558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ed0cd94ec14107858f91ff29e82e7f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:40.882371 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1327/2655] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:40 2022] DELETE /identity/v3/users/b9ed0cd94ec14107858f91ff29e82e7f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:40.887698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:40.888201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:40.888520 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:40.910167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:40.911500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:40.915658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:40.976699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1329/2656] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:40.986553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:40.987976 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:41.050604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781ec3-07b8-4a48-b48a-420e355f57b0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.054561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.055204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.055517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.055750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.066592 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.068146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.079133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1328/2657] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:41.377416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.378868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:41.391997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0ad11-917b-4f6a-a801-3b94de5980cf None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.398293 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.399030 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.399430 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.399713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] PATH_INFO: `/v3/projects/b125140776ad40b0954523baaf443ade` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.401043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b125140776ad40b0954523baaf443ade)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.403024 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.478247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b125140776ad40b0954523baaf443ade', 'request_id': 'req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.487025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b125140776ad40b0954523baaf443ade', 'request_id': 'req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.495641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b125140776ad40b0954523baaf443ade', 'request_id': 'req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.509350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] The token cache is being invalidate because project b125140776ad40b0954523baaf443ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:41.509979 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.511525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.513689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1330/2658] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:41 2022] DELETE /identity/v3/projects/b125140776ad40b0954523baaf443ade => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:41.519092 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.531770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd540c4-3cc0-4f01-88b2-adb10b61c629 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.615505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.616247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.616606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.616895 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] PATH_INFO: `/v3/users/0d331a8afc2244a0bdb3b1e88e394392` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.618321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d331a8afc2244a0bdb3b1e88e394392)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.620275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.646530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:41.680950 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d331a8afc2244a0bdb3b1e88e394392'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.681651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d331a8afc2244a0bdb3b1e88e394392'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.682517 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d331a8afc2244a0bdb3b1e88e394392'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.697045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d331a8afc2244a0bdb3b1e88e394392'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.706174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-db512308-e24b-4317-8c5b-dabb7361f5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d331a8afc2244a0bdb3b1e88e394392'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.719789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1329/2659] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:41 2022] DELETE /identity/v3/users/0d331a8afc2244a0bdb3b1e88e394392 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:42.011171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.012742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.026699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9d07e-1413-4690-8c3d-5a7d0dea106c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.099241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.099888 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.100176 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.100455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] PATH_INFO: `/v3/projects/391a793ed6a547ada710bca54307bf91` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.101857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391a793ed6a547ada710bca54307bf91)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.104265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.146296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:42.158271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391a793ed6a547ada710bca54307bf91', 'request_id': 'req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.168470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391a793ed6a547ada710bca54307bf91', 'request_id': 'req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.182865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391a793ed6a547ada710bca54307bf91', 'request_id': 'req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.193693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] The token cache is being invalidate because project 391a793ed6a547ada710bca54307bf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:42.194032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.194751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c5ecb19-2f89-4cc0-96fa-e6f488a05701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.196304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1331/2660] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:42 2022] DELETE /identity/v3/projects/391a793ed6a547ada710bca54307bf91 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:42.201820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.202172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.202449 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.223001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:42.224339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.288857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1330/2661] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:42.297364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.297661 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.297984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.318980 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:42.320204 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.328796 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1332/2662] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:42.333317 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.343861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20b2b8-eae2-4a73-92cd-add8ea2ab226 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.348728 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.349343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.349630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.349946 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.350612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:42.350925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.352527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.368355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1331/2663] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:59:42.370112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.379710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a1fd-133b-4330-8505-5719d4dca174 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.384355 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.385008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.385287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.385558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.386257 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.388148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.419640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1333/2664] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:42.424160 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.440055 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d63b-5019-47d9-a25a-3964d79ba265 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.502075 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.503029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.503029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.503222 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.503869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.505810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.528429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1332/2665] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:42.532624 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.545875 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535545f-efd7-4d03-941a-213c98cc3caf admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.554202 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.554658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.555066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.555410 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.557852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.559834 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.582036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1334/2666] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:42.583275 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.596679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67114-700c-4c6a-a83f-d83a9c83a6f6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.604241 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.604923 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.605216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.605504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.607330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.608912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1dcf8-5b00-4b9b-acef-3093bbcdc3a8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.621228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1333/2667] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:42.625473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.636969 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697069-8248-4221-ab96-916b60727bdf admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.642465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.643142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.643437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.643721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] PATH_INFO: `/v3/projects/b0d1613c4a9e44a29c7d15695adae71a/users/c3ec6d260fe04d93bfe98058275420c1/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.660640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d1613c4a9e44a29c7d15695adae71a, user_id=c3ec6d260fe04d93bfe98058275420c1, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.663418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.678935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1335/2668] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:42 2022] PUT /identity/v3/projects/b0d1613c4a9e44a29c7d15695adae71a/users/c3ec6d260fe04d93bfe98058275420c1/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:42.690469 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.690749 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.691027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.704118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:42.727722 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] MFA Rules not processed for user `c3ec6d260fe04d93bfe98058275420c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:42.729641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.806004 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1334/2669] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:42.810682 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.877451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b583-9d8a-4a21-9818-22899ea84070 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.882334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.882960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.883249 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.883532 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.884184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.886126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.915622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1336/2670] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:42.920213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.931274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9e80-4e1c-45f9-98d8-a4978287798e None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.990513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.991135 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.991538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.991817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.992466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.994446 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.017693 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1335/2671] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:43.021688 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.033082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b077-0653-468b-9dc8-7b9a03c1a640 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.038290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.038777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.039064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.039346 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.039995 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.042181 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.054103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1337/2672] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:43.058546 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.073304 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2d51-2eee-4796-8d1f-806b42370e57 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.075142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.075829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.076454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.076626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] PATH_INFO: `/v3/projects/3eb33065d702465e9c06033675279c90/users/45562911a7e24e379b9489f199f93528/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.096136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb33065d702465e9c06033675279c90, user_id=45562911a7e24e379b9489f199f93528, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.099301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.116712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1336/2673] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:43 2022] PUT /identity/v3/projects/3eb33065d702465e9c06033675279c90/users/45562911a7e24e379b9489f199f93528/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:43.125224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.140047 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcf3f8-100e-48d2-aca0-c3b03496c164 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.176364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.210590 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.211203 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.211619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.211914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.212628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.214285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46275-f3e0-4a19-8d9a-dce6bdbe27fd admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.227748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1338/2674] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:43.232379 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.248488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92ffa2-c1ae-4380-8de5-dd8360cc70af admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.254206 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.254888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.255175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.255458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] PATH_INFO: `/v3/projects/3eb33065d702465e9c06033675279c90/users/45562911a7e24e379b9489f199f93528/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.257528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb33065d702465e9c06033675279c90, user_id=45562911a7e24e379b9489f199f93528, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.260308 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.273634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1337/2675] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:43 2022] PUT /identity/v3/projects/3eb33065d702465e9c06033675279c90/users/45562911a7e24e379b9489f199f93528/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:43.286345 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.286701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.288187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.320134 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] MFA Rules not processed for user `45562911a7e24e379b9489f199f93528`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:43.321363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:43.390402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1339/2676] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:43.401521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.403324 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:43.461505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.467688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31594-07cc-4820-a812-20fc3e286b9a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.472144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.472786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.473157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.473340 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.488390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.490667 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.502924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1338/2677] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:43.590647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.604597 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799c26a-e8ac-497f-bc6a-0de65dd9725a None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.608429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.609036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.609382 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.609867 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.671789 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.673276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7f80d-dd4b-4f7d-b989-92ae595ad188 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.684002 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1340/2678] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:46.477376 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:46.479754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:46.569171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155e96c-cf71-4567-9ed9-f4b5e124be8f service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:46.574602 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:46.575249 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:46.575531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:46.575858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] PATH_INFO: `/v3/users/174e46c026084161a72a73f5e3355089` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:46.576958 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174e46c026084161a72a73f5e3355089)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:46.578924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:46.653834 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174e46c026084161a72a73f5e3355089'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:46.654607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174e46c026084161a72a73f5e3355089'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:46.655238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174e46c026084161a72a73f5e3355089'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:46.668450 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174e46c026084161a72a73f5e3355089'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:46.677847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174e46c026084161a72a73f5e3355089'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:46.692359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1339/2679] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:46 2022] DELETE /identity/v3/users/174e46c026084161a72a73f5e3355089 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:46.697876 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:46.698548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:46.698548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:46.725933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:46.727485 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:46.784509 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:46.799066 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1341/2680] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:46.813670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:46.815911 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:46.882849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea3e00-b2c6-4216-97e4-45133d340b16 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:46.886981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:46.887600 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:46.887887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:46.888168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:46.897842 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:46.899320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:46.910933 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1340/2681] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:47.188020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:47.189574 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:47.207433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b12be-d646-4e5d-8541-ebe026d707a6 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:47.215217 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:47.215880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:47.216169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:47.216467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] PATH_INFO: `/v3/projects/99013171fca243cda0c0bc4384f25c5c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:47.217635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=99013171fca243cda0c0bc4384f25c5c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:47.219646 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:47.277478 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99013171fca243cda0c0bc4384f25c5c', 'request_id': 'req-6121799a-3252-41f2-9c48-efd6a7bff2ad'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.286226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99013171fca243cda0c0bc4384f25c5c', 'request_id': 'req-6121799a-3252-41f2-9c48-efd6a7bff2ad'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.293145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99013171fca243cda0c0bc4384f25c5c', 'request_id': 'req-6121799a-3252-41f2-9c48-efd6a7bff2ad'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.303973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] The token cache is being invalidate because project 99013171fca243cda0c0bc4384f25c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:47.304265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.304932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6121799a-3252-41f2-9c48-efd6a7bff2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.307079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1342/2682] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:47 2022] DELETE /identity/v3/projects/99013171fca243cda0c0bc4384f25c5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:47.813649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:47.815194 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:47.827999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df7208-355b-4c2d-afbb-3a1080ae4841 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:47.839152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:47.890053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:47.890699 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:47.890988 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:47.891270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] PATH_INFO: `/v3/users/c3ec6d260fe04d93bfe98058275420c1` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:47.892454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ec6d260fe04d93bfe98058275420c1)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:47.894452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:47.950125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ec6d260fe04d93bfe98058275420c1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.950789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ec6d260fe04d93bfe98058275420c1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.951681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ec6d260fe04d93bfe98058275420c1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.964123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ec6d260fe04d93bfe98058275420c1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.971914 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ec6d260fe04d93bfe98058275420c1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:47.985953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1341/2683] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:47 2022] DELETE /identity/v3/users/c3ec6d260fe04d93bfe98058275420c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:47.990550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:47.991022 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:47.991148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.011081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:48.012314 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:48.073402 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1343/2684] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:48.084634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:48.086189 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:48.148119 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a494-8146-4436-ae76-341a6e5aeeec admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:48.152549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:48.153172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.153456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.153731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.164149 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:48.165620 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:48.176188 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1342/2685] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:48.517380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:48.518853 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:48.540782 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338f226-b1d2-4ca0-b8f1-c471e6568a34 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:48.556088 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:48.556676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.556971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.557259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] PATH_INFO: `/v3/projects/b0d1613c4a9e44a29c7d15695adae71a` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.558545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d1613c4a9e44a29c7d15695adae71a)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:48.560748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:48.614255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d1613c4a9e44a29c7d15695adae71a', 'request_id': 'req-541d57c3-b2ad-46c8-b2f9-47e778708b64'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.621715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d1613c4a9e44a29c7d15695adae71a', 'request_id': 'req-541d57c3-b2ad-46c8-b2f9-47e778708b64'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.628148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d1613c4a9e44a29c7d15695adae71a', 'request_id': 'req-541d57c3-b2ad-46c8-b2f9-47e778708b64'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.643380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:48.648517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] The token cache is being invalidate because project b0d1613c4a9e44a29c7d15695adae71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:48.649090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.649959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.652711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1344/2686] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:48 2022] DELETE /identity/v3/projects/b0d1613c4a9e44a29c7d15695adae71a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:48.656793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:48.666660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14ea6-fbb4-4589-80a9-bf8a32068c7b service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:48.702726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:48.730887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:48.731527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.731817 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.732100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] PATH_INFO: `/v3/users/45562911a7e24e379b9489f199f93528` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.733259 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45562911a7e24e379b9489f199f93528)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:48.735225 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:48.782228 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45562911a7e24e379b9489f199f93528'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.782894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45562911a7e24e379b9489f199f93528'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.783509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45562911a7e24e379b9489f199f93528'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.796696 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45562911a7e24e379b9489f199f93528'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.803808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-e39fc5b2-d4d5-46d0-a1ad-c36213f0f1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45562911a7e24e379b9489f199f93528'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.816852 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1343/2687] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:48 2022] DELETE /identity/v3/users/45562911a7e24e379b9489f199f93528 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:49.131384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.132909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.148465 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d57c3-b2ad-46c8-b2f9-47e778708b64 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.216052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.216606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.216918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.217178 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] PATH_INFO: `/v3/projects/3eb33065d702465e9c06033675279c90` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.218364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb33065d702465e9c06033675279c90)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.220734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.279718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb33065d702465e9c06033675279c90', 'request_id': 'req-2e9faf30-7259-49aa-85a7-a6152fde54d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.287565 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb33065d702465e9c06033675279c90', 'request_id': 'req-2e9faf30-7259-49aa-85a7-a6152fde54d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.305065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb33065d702465e9c06033675279c90', 'request_id': 'req-2e9faf30-7259-49aa-85a7-a6152fde54d6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.316974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] The token cache is being invalidate because project 3eb33065d702465e9c06033675279c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:49.317269 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.317959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2e9faf30-7259-49aa-85a7-a6152fde54d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.319453 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1345/2688] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:49 2022] DELETE /identity/v3/projects/3eb33065d702465e9c06033675279c90 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:49.324851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.325168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.325448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.347886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:49.349220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.409734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1344/2689] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:49.417628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.417891 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.418173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.440658 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:49.441894 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.450558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1346/2690] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:49.455068 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.465535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb502d8-37bb-498a-b29b-7c338a8e6ba2 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.472643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.473197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.473465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.473742 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.474422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:49.474748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.476325 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.488438 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1345/2691] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:59:49.492874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.504795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757fc1-ec71-4a13-b9ff-5ef442f6edd4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.510348 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.510959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.511242 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.511511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.512148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.514064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.541669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1347/2692] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:49.548178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.558408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90bd1-1f83-464f-9b5f-1092094d0851 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.606035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:49.625935 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.626550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.626846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.627116 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.627766 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.629670 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.652605 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1346/2693] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:49.658326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.669797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78efc4-2414-4118-a324-a45a88bbdf0b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.674687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.675303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.675582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.675859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.676516 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.678152 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.816205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1348/2694] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:49.820381 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.831395 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4567c-785d-4f6d-b10f-d33ea109003f admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.838717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.839341 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.839631 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.839909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.840627 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.842854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a56e0a-d47d-4e15-b3ef-214fe2a38ac5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.855832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1347/2695] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:49.860678 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.874420 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bfd4a-39cc-47b6-a6b1-5576b9ef4937 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.879457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.880125 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.880412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.880691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] PATH_INFO: `/v3/projects/6b1e01b5a3a2428d996f73c9407e4577/users/328525422f394481823dc9f00f9aadce/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.895977 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1e01b5a3a2428d996f73c9407e4577, user_id=328525422f394481823dc9f00f9aadce, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.898655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.911662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1349/2696] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:49 2022] PUT /identity/v3/projects/6b1e01b5a3a2428d996f73c9407e4577/users/328525422f394481823dc9f00f9aadce/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:49.923519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.923813 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.924098 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.953018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] MFA Rules not processed for user `328525422f394481823dc9f00f9aadce`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:49.954273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:50.022147 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1348/2697] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:50.027020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.057254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:50.091639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c189ac-8896-486b-bbaf-8c9c7614dd7a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.096011 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.096633 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.097050 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.097172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.097742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.099636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.130639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1350/2698] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:50 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:50.134726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.145967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faaede-e92c-4f9f-b25a-66929e0b3b1b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.208879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.209495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.209879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.210109 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.210726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.213163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.235927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1349/2699] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:50 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:50.241893 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.253389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91294d-e76b-4a79-ac2f-1a4ba37f6427 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.258364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.259020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.259308 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.260182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.260835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.262458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.273285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1351/2700] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:50.278301 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.293420 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66488-47d7-4de7-be13-16af3861756c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.300024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.300876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.301474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.301909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] PATH_INFO: `/v3/projects/1632d562f38f4d7689af91f64c0abee7/users/79f83eb6486a4062a2f74b51f7942d98/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.324375 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1632d562f38f4d7689af91f64c0abee7, user_id=79f83eb6486a4062a2f74b51f7942d98, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.327178 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.341027 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1350/2701] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:50 2022] PUT /identity/v3/projects/1632d562f38f4d7689af91f64c0abee7/users/79f83eb6486a4062a2f74b51f7942d98/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:50.353171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.363578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0491bc-5a12-4af8-bf8c-f578b65ac289 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.428542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.429413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.429706 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.430037 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.430704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.432858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a9f54-6173-43e2-9ce2-c5e42a4601b9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.443728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1352/2702] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:50.448604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.459454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf4c6-9566-4e08-a3a3-94a50d8a4c5b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.464234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.464891 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.465176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.465551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] PATH_INFO: `/v3/projects/1632d562f38f4d7689af91f64c0abee7/users/79f83eb6486a4062a2f74b51f7942d98/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.467707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1632d562f38f4d7689af91f64c0abee7, user_id=79f83eb6486a4062a2f74b51f7942d98, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.470413 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.481522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1351/2703] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:50 2022] PUT /identity/v3/projects/1632d562f38f4d7689af91f64c0abee7/users/79f83eb6486a4062a2f74b51f7942d98/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:50.492396 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.492767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.493082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.532840 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] MFA Rules not processed for user `79f83eb6486a4062a2f74b51f7942d98`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:50.534094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:50.605273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1353/2704] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:50.616271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.618005 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:50.623429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:50.679246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed501-74fe-460f-ab5e-f4cfa7957ad5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.684769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.685522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.685840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.686117 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.695586 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.697528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.707211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1352/2705] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:50.814537 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.824896 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763c8c-8b12-49a5-80db-ea721b82fa8f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.828676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.829278 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.829563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.829877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.849861 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:50.897576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.899038 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b41c1-54bd-43c9-ba77-12766e4a655a service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.909105 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1354/2706] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:53.520417 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:53.585953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249429-9e6b-4149-89f1-89744ad431f4 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:53.591254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:53.591890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:53.592176 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:53.592455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] PATH_INFO: `/v3/users/328525422f394481823dc9f00f9aadce` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:53.593587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=328525422f394481823dc9f00f9aadce)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:53.595565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:53.646232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328525422f394481823dc9f00f9aadce'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:53.646889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328525422f394481823dc9f00f9aadce'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:53.647563 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328525422f394481823dc9f00f9aadce'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:53.662716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328525422f394481823dc9f00f9aadce'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:53.670734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328525422f394481823dc9f00f9aadce'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:53.683706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1353/2707] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:53 2022] DELETE /identity/v3/users/328525422f394481823dc9f00f9aadce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:53.688674 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:53.689145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:53.689240 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:53.715438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:53.716647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:53.781065 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1355/2708] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:53.794737 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:53.797050 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:53.828152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:53.860820 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ac738-befd-43bf-a7c4-08e59ffc9d9b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:53.864857 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:53.865618 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:53.865928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:53.866214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:53.876402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:53.878520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:53.890244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1354/2709] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:54.214935 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:54.218356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:54.231472 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87bb7e-245e-4e0a-9175-916ccf6a41ad None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:54.236173 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:54.236818 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:54.237153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:54.237432 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] PATH_INFO: `/v3/projects/6b1e01b5a3a2428d996f73c9407e4577` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:54.238930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1e01b5a3a2428d996f73c9407e4577)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:54.240823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:54.297653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1e01b5a3a2428d996f73c9407e4577', 'request_id': 'req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.305627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1e01b5a3a2428d996f73c9407e4577', 'request_id': 'req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.315676 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1e01b5a3a2428d996f73c9407e4577', 'request_id': 'req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.329162 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] The token cache is being invalidate because project 6b1e01b5a3a2428d996f73c9407e4577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:54.329470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.330179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.331643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1356/2710] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:54 2022] DELETE /identity/v3/projects/6b1e01b5a3a2428d996f73c9407e4577 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:54.335849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:54.346167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c344-d562-4b05-9e7b-3fa63f8e72b0 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:54.412155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:54.413029 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:54.413437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:54.413738 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] PATH_INFO: `/v3/users/79f83eb6486a4062a2f74b51f7942d98` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:54.415644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f83eb6486a4062a2f74b51f7942d98)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:54.419082 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:54.470496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f83eb6486a4062a2f74b51f7942d98'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.471157 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f83eb6486a4062a2f74b51f7942d98'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.471991 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f83eb6486a4062a2f74b51f7942d98'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.485327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f83eb6486a4062a2f74b51f7942d98'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.493248 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-782585df-ba38-4360-abe9-f423adfcad31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f83eb6486a4062a2f74b51f7942d98'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.506431 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1355/2711] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:54 2022] DELETE /identity/v3/users/79f83eb6486a4062a2f74b51f7942d98 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:54.803501 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:54.805094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:54.819294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e2eaf-7d67-4541-b714-65bf9e8e4eb0 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:54.870129 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:54.888107 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:54.888748 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:54.889027 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:54.889298 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] PATH_INFO: `/v3/projects/1632d562f38f4d7689af91f64c0abee7` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:54.891254 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1632d562f38f4d7689af91f64c0abee7)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:54.893225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:54.952259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1632d562f38f4d7689af91f64c0abee7', 'request_id': 'req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.961101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1632d562f38f4d7689af91f64c0abee7', 'request_id': 'req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.972081 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1632d562f38f4d7689af91f64c0abee7', 'request_id': 'req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.986253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] The token cache is being invalidate because project 1632d562f38f4d7689af91f64c0abee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:54.986781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.987677 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-600cdfbb-5aa0-45ca-b9f8-c78b99e54ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:54.989406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1357/2712] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:54 2022] DELETE /identity/v3/projects/1632d562f38f4d7689af91f64c0abee7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:54.995543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:54.996212 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:54.996370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.016427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:55.017642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:55.064565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:55.083808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1356/2713] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:55.093193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.093483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.093869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.114702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:55.115797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:55.125052 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1358/2714] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:55.130593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.147046 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fda9d-fb22-4401-819c-b9ee6089d6b3 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.153161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.154112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.154455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.154789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.155414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:55.155725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.157389 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.170035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1357/2715] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:55.174760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.184598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738a021-3d3e-4f70-96b8-7344b87055a8 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.189797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.190431 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.190718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.191144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.191794 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.193728 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.230788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1359/2716] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:55 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:55.232638 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.245550 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd79d6-47ee-447a-9d01-08c0d0530675 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.327256 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.328122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.328548 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.328994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.330144 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.332640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.355458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1358/2717] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:55 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:55.362276 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.378356 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52fd7e-01e1-46ce-bf25-418ce2377093 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.384991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.385649 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.385964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.386235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.386899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.388508 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.399617 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1360/2718] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:55.404543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.415300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cbbf7-0039-4870-b471-1f14540100d8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.420505 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.421125 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.421414 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.421712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.422384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.424014 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb58f1-c6de-48ad-ae1e-96e872f06f5a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.437130 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1359/2719] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:55.442629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.454068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ca65-742f-40e9-9133-70d784df5f8c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.459092 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.459781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.460077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.460361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] PATH_INFO: `/v3/projects/2700665c48654cef8f1d56a4d9461871/users/e19cc6bdbdf7401b95f19d83b1394659/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.476882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2700665c48654cef8f1d56a4d9461871, user_id=e19cc6bdbdf7401b95f19d83b1394659, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.479645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.493145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1361/2720] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:55 2022] PUT /identity/v3/projects/2700665c48654cef8f1d56a4d9461871/users/e19cc6bdbdf7401b95f19d83b1394659/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:55.505036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.505318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.505595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.539074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] MFA Rules not processed for user `e19cc6bdbdf7401b95f19d83b1394659`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:55.540315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:55.613156 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1360/2721] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:55.621404 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.623182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:55.686349 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6478d-289e-4315-846f-177ff5a1b7a5 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.690563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.691184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.691467 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.691744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.702193 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.704909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def102c-4c91-4cfd-a34b-fa6fed21d955 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.721045 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1362/2722] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:55.743059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:55.795311 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:55.818339 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc850bd-1c55-4342-8b05-caa63e969d71 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:55.823177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:55.823823 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.824110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.824390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] PATH_INFO: `/v3/users/e19cc6bdbdf7401b95f19d83b1394659` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.825614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19cc6bdbdf7401b95f19d83b1394659)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:55.827810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:55.904059 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19cc6bdbdf7401b95f19d83b1394659'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:55.904648 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19cc6bdbdf7401b95f19d83b1394659'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:55.905992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19cc6bdbdf7401b95f19d83b1394659'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:55.921588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19cc6bdbdf7401b95f19d83b1394659'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:55.933984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19cc6bdbdf7401b95f19d83b1394659'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:55.949705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1361/2723] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:55 2022] DELETE /identity/v3/users/e19cc6bdbdf7401b95f19d83b1394659 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:55.954273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710436da-b234-47e1-994e-3593166dfd44 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:55.954777 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710436da-b234-47e1-994e-3593166dfd44 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:55.954928 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710436da-b234-47e1-994e-3593166dfd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:55.975323 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-710436da-b234-47e1-994e-3593166dfd44 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:55.976547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-710436da-b234-47e1-994e-3593166dfd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:55.985653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:56.043411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1363/2724] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:56.053512 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:56.055067 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:56.126761 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaaf22-2bc8-460d-b153-ee93db589cc4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:56.130529 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:56.131155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.131435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.131707 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.142262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:56.143719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420b6e4-e0f7-4886-a03a-9f97d9e4d7e8 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:56.155011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1362/2725] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:56.488313 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710436da-b234-47e1-994e-3593166dfd44 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:56.489957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-710436da-b234-47e1-994e-3593166dfd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:56.503265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710436da-b234-47e1-994e-3593166dfd44 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:56.508287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:56.509077 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.509300 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.509705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] PATH_INFO: `/v3/projects/2700665c48654cef8f1d56a4d9461871` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.510964 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2700665c48654cef8f1d56a4d9461871)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:56.512889 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:56.580850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2700665c48654cef8f1d56a4d9461871', 'request_id': 'req-381be50b-09ab-4d7a-ac7f-003f303a9318'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:56.589325 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2700665c48654cef8f1d56a4d9461871', 'request_id': 'req-381be50b-09ab-4d7a-ac7f-003f303a9318'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:56.596628 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2700665c48654cef8f1d56a4d9461871', 'request_id': 'req-381be50b-09ab-4d7a-ac7f-003f303a9318'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:56.609998 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] The token cache is being invalidate because project 2700665c48654cef8f1d56a4d9461871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:56.610357 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:56.611126 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-381be50b-09ab-4d7a-ac7f-003f303a9318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:56.612895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1364/2726] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:56 2022] DELETE /identity/v3/projects/2700665c48654cef8f1d56a4d9461871 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:56.618354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.618748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.619173 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.640171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:56.641453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:56.709028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1363/2727] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:56.717412 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.717702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.718245 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.741263 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:56.742461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:56.753988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1365/2728] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:56.766327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:56.791236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:56.796999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b857-753b-4437-9b4e-d15887e53dbf None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:56.821565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:56.824110 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.824608 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.826236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.827352 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:56.828463 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:56.831022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:56.860614 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1364/2729] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:56.861474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:56.880835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756fc1f-2388-4cc4-83bd-7aa2067ef1b2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:56.886746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:56.888251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:56.888548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:56.888857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:56.889576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:56.892251 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:56.945222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1366/2730] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:56 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:56.950681 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:56.965281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3433e-7ec8-4329-a6b1-69c7ae3745c8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:57.051343 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:57.051903 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.052190 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.052520 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.053151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:57.055172 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:57.081510 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1365/2731] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:56 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:57.085727 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:57.096988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e7a63-dd6f-4047-90ad-ada840781173 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:57.105799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:57.106774 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.107019 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.107515 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.108679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:57.111271 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:57.127224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1367/2732] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:57.131365 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:57.142458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb0f-e94c-44a3-bfe4-5ddaff9250f5 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:57.147315 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:57.147942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.148239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.148566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.149202 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:57.151057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a92a-7a37-4cf1-a6f4-3cfda8e77e30 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:57.162453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1366/2733] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:57.166811 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:57.177696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56537b-b0ee-4fd0-b3eb-429d314a2258 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:57.183031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:57.183721 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.184006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.184283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] PATH_INFO: `/v3/projects/d7c141f811c84111a73b167c7ab4a998/users/dcb890efd77c4e3481cc2097f24d31bf/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.202812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c141f811c84111a73b167c7ab4a998, user_id=dcb890efd77c4e3481cc2097f24d31bf, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:57.205445 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:57.224953 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1368/2734] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:57 2022] PUT /identity/v3/projects/d7c141f811c84111a73b167c7ab4a998/users/dcb890efd77c4e3481cc2097f24d31bf/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:57.236925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.237408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.237975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.278810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] MFA Rules not processed for user `dcb890efd77c4e3481cc2097f24d31bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:57.280108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:57.361975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1367/2735] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 05:59:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:57.377307 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:57.379440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:57.430857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:57.458652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822439-dc0a-4b90-96f7-930b86250185 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:57.462874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:57.463626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:57.463770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:57.464042 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:57.475342 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:57.476871 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:57.489411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1369/2736] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:00.686113 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:00.687524 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:00.744792 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ef47-fa53-41e8-95f0-149c405df12a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:00.748533 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:00.749196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:00.749435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:00.749759 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:00.751551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:00.765258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.817994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:00.819448 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:00.829941 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1368/2737] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:04.002632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.004347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.019583 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02d96d-ba7f-4230-9935-e5b2eda950fa service cinder] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.024297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.024949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.025228 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.025499 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] PATH_INFO: `/v3/users/e47e1b7589bb427aa13c27f7bc1d6d9c` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.026689 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47e1b7589bb427aa13c27f7bc1d6d9c)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.028615 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.077974 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47e1b7589bb427aa13c27f7bc1d6d9c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.078545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47e1b7589bb427aa13c27f7bc1d6d9c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.090335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47e1b7589bb427aa13c27f7bc1d6d9c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.090966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47e1b7589bb427aa13c27f7bc1d6d9c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.098973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-68bf05eb-05b7-4878-9d10-694e5e306f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47e1b7589bb427aa13c27f7bc1d6d9c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.112667 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1370/2738] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:04 2022] DELETE /identity/v3/users/e47e1b7589bb427aa13c27f7bc1d6d9c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:04.285662 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.296475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a50e57-8407-4db7-9dcf-ea09595139e6 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.356972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.357536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.357859 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.358235 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] PATH_INFO: `/v3/projects/03fa94320f714ab881aa0b9d4c077d6c` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.359410 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fa94320f714ab881aa0b9d4c077d6c)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.361332 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.408118 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fa94320f714ab881aa0b9d4c077d6c', 'request_id': 'req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.414264 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fa94320f714ab881aa0b9d4c077d6c', 'request_id': 'req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.420779 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fa94320f714ab881aa0b9d4c077d6c', 'request_id': 'req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.434073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] The token cache is being invalidate because project 03fa94320f714ab881aa0b9d4c077d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:04.434743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.435411 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-58fe94c9-cfc4-4e08-9b6c-d3de80acec49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.436927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1369/2739] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:04 2022] DELETE /identity/v3/projects/03fa94320f714ab881aa0b9d4c077d6c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:04.441960 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.442247 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.442525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.465873 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.467664 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.538540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1371/2740] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:04.549368 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.549716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.550041 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.574561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.575938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.584606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1370/2741] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:04.590681 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.600659 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089a09c-8b38-4a87-a3f5-98865cc7ff6e None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.606353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.607374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.607566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.608455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.608455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:00:04.608845 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.610600 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.624335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1372/2742] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:00:04.629072 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.640185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f764-cabc-46dc-b577-c20c61f13ae9 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.646873 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.647822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.648269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.648665 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.650366 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.654026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.696743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1371/2743] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:04.701297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.717028 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12508b-671b-4326-b3fb-da3b0d0739a2 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.754035 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:04.784670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.785306 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.785589 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.785905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.786560 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.788444 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.810511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1373/2744] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:04.814733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.827278 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cbb1-15ff-4527-a5f7-c90398d2b06b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.832001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.832611 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.833167 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.833421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.834123 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.835811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.965203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:04.971580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1372/2745] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:04.975458 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.985756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cc45-788a-4379-abed-18cd5aef29a2 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.991734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.992885 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.993009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.993399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.994648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.996564 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c14f2-f793-4ba7-85a6-a26cbf5d2f9c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:05.013577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1374/2746] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:00:05.014811 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:05.026454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967aff5-9a7e-46ef-87c3-941725a52191 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:05.031258 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:05.031912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:05.032191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:05.032465 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] PATH_INFO: `/v3/projects/872bd79f407c491ba725d88aa9f85b34/users/92c01f3992404a2dbd4580ffad33d6c1/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:05.047226 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] RBAC: Authorizing `identity:create_grant(project_id=872bd79f407c491ba725d88aa9f85b34, user_id=92c01f3992404a2dbd4580ffad33d6c1, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:05.049868 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:05.064234 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1373/2747] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:05 2022] PUT /identity/v3/projects/872bd79f407c491ba725d88aa9f85b34/users/92c01f3992404a2dbd4580ffad33d6c1/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:05.069549 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:05.069917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:05.070155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:05.089945 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:05.091143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:05.148603 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1375/2748] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:05.158972 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:05.160719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:05.218808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695685-97bf-4335-88c7-c611d04e617e admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:05.222316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:05.222920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:05.223205 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:05.223477 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:05.232700 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:05.234216 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b015-5abc-4bdd-8f55-bbb14d26cbc2 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:05.244331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1374/2749] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:07.861860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:07.864730 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:07.880241 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ede3b-d3c1-4fbf-8263-7e2ddc10e632 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:07.887921 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:07.888713 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:07.889004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:07.889283 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] PATH_INFO: `/v3/users/dcb890efd77c4e3481cc2097f24d31bf` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:07.890807 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb890efd77c4e3481cc2097f24d31bf)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:07.893655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:07.965694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb890efd77c4e3481cc2097f24d31bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:07.966599 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb890efd77c4e3481cc2097f24d31bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:07.982684 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb890efd77c4e3481cc2097f24d31bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:07.988447 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb890efd77c4e3481cc2097f24d31bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.000388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb890efd77c4e3481cc2097f24d31bf'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.020868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1376/2750] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:07 2022] DELETE /identity/v3/users/dcb890efd77c4e3481cc2097f24d31bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:08.026150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.026718 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.027000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.048466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:08.049931 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.125805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1375/2751] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:00:08.137535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.139495 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.176510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:08.214119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036309e-40f7-4719-8f16-37a8dda7dc9d admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.218130 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.218762 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.219192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.219473 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.229919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.231367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4820dec-76d3-4d6a-bfde-a6c275615b04 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.242429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1377/2752] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:08.715320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.717406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.744683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633b7e-80d9-4d33-b181-6f4635e23c85 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.757943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.762105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.762105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.762105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] PATH_INFO: `/v3/projects/d7c141f811c84111a73b167c7ab4a998` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.762105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c141f811c84111a73b167c7ab4a998)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.764484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.840924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c141f811c84111a73b167c7ab4a998', 'request_id': 'req-2153bde1-8511-4570-b311-4b05b05a3c31'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.850906 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c141f811c84111a73b167c7ab4a998', 'request_id': 'req-2153bde1-8511-4570-b311-4b05b05a3c31'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.858306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c141f811c84111a73b167c7ab4a998', 'request_id': 'req-2153bde1-8511-4570-b311-4b05b05a3c31'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.883268 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] The token cache is being invalidate because project d7c141f811c84111a73b167c7ab4a998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:08.885888 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.890045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-2153bde1-8511-4570-b311-4b05b05a3c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.892327 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1376/2753] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:08 2022] DELETE /identity/v3/projects/d7c141f811c84111a73b167c7ab4a998 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:08.897566 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.898791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.898791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.920744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:08.922284 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.018064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1378/2754] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:09.085049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.085607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.085607 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.094336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:09.109521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:09.111215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.120576 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1377/2755] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:09.124917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.135982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c0e6-858d-4a27-80dc-10f52a809104 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.141710 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.142391 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.143334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.143334 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.143652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:00:09.143957 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.145567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.161148 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1379/2756] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:00:09.165822 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.178788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae584d-aaab-40bc-8de5-a2f807926c1b None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.185706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.186587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.187086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.187536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.188348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.190682 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.226930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1378/2757] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:09.232400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.244971 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf040d-c504-4b7a-ab9b-a07f1613a749 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.320344 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.321856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.322270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.322644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.323369 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.325376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.350592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1380/2758] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:09.354522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.365750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8bf7-ed90-4cc8-8d6b-8b2bfdbfa5f9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.371142 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.371409 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.372034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.372034 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.372689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.374336 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.389179 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1379/2759] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:09.390626 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.405260 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449f12-e701-4924-8975-da6b866efa2f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.415679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.416856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.416856 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.417195 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.418041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.424593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ab3f5-2be8-4b8a-8f3c-6afb608c7c9d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.449694 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1381/2760] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:00:09.454100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.471527 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cc1f2-3a94-47e3-9321-69cb3112fead admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.476554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.477551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.478042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.478494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] PATH_INFO: `/v3/projects/4dcb796bdd4d4e5b95e2406ca84a5f96/users/4726882c02334bf89bc891e9fdabc6a1/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.506274 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb796bdd4d4e5b95e2406ca84a5f96, user_id=4726882c02334bf89bc891e9fdabc6a1, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.510556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.535831 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39f70-fcc1-4f3b-8af6-3286482682bc None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.536124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39f70-fcc1-4f3b-8af6-3286482682bc None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.536405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39f70-fcc1-4f3b-8af6-3286482682bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.548808 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1380/2761] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:09 2022] PUT /identity/v3/projects/4dcb796bdd4d4e5b95e2406ca84a5f96/users/4726882c02334bf89bc891e9fdabc6a1/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:09.562205 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-74c39f70-fcc1-4f3b-8af6-3286482682bc None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:09.563576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-74c39f70-fcc1-4f3b-8af6-3286482682bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.605339 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:09.646039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1382/2762] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:09.656443 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.659846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.721675 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a4f-eaa9-4c0a-90bc-966d21bf2e2c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.726473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.727100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.727442 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.727717 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.741584 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.743461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.756280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1381/2763] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:09.945821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d0c1-8df5-4aa0-86c6-e79078af6cf0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.946397 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d0c1-8df5-4aa0-86c6-e79078af6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.946498 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d0c1-8df5-4aa0-86c6-e79078af6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.998399 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-1071d0c1-8df5-4aa0-86c6-e79078af6cf0 None None] MFA Rules not processed for user `92c01f3992404a2dbd4580ffad33d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:09.999705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1071d0c1-8df5-4aa0-86c6-e79078af6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:10.104207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1383/2764] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:10.119349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:10.120889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:10.277606 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ac6-20a9-4813-ae98-82ac93aae635 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:10.295021 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:10.295752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:10.296037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:10.296318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:10.315073 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:10.316807 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:10.352844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1382/2765] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:13.295635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a121-8aec-4713-9c69-c9845ee8f40a None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:13.298147 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a121-8aec-4713-9c69-c9845ee8f40a None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:13.298625 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a121-8aec-4713-9c69-c9845ee8f40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:13.350394 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-2bd5a121-8aec-4713-9c69-c9845ee8f40a None None] MFA Rules not processed for user `92c01f3992404a2dbd4580ffad33d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:13.352757 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2bd5a121-8aec-4713-9c69-c9845ee8f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:13.365350 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1384/2766] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:14.700435 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:14.717642 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff03f3-c021-4988-a857-92707f11a28b service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:14.731679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:14.732331 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:14.732619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:14.732910 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:14.735009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:14.764349 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:14.766960 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:14.795063 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1383/2767] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:17.258497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.258987 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.259087 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.304745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] MFA Rules not processed for user `4726882c02334bf89bc891e9fdabc6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:17.306915 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:17.397511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1385/2768] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:00:17.402637 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.417475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f2f9-e04c-48c1-b9f0-51c910e6f24a service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.422733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.423484 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.423841 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.424177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.424887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.426993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.440666 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:17.460625 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1384/2769] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:00:17 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:17.464839 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.478675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a879c-d73e-4529-97c1-84fa37d8e2ba None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.528906 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=100 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:17.544143 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.544799 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.545086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.545375 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.546142 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.551275 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.587793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1386/2770] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:00:17 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:17.591869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.604033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215e79-2c4d-48e7-962f-cc92afffd9dc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.610513 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.611273 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.613302 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.613658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.614802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.618905 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.633013 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1385/2771] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:17.637966 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.652025 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d404ef-1db8-40bf-8f88-96d5fec6a55e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.664122 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.664763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.665051 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.665340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] PATH_INFO: `/v3/projects/fba96335fb174f5eaadda38e253f821d/users/c29c7d3ebe924c07989d54c9ca05bb24/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.708238 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba96335fb174f5eaadda38e253f821d, user_id=c29c7d3ebe924c07989d54c9ca05bb24, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.717036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.753233 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1387/2772] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:17 2022] PUT /identity/v3/projects/fba96335fb174f5eaadda38e253f821d/users/c29c7d3ebe924c07989d54c9ca05bb24/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:17.757108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.775858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7377-10c1-47bd-b21b-84ccdc4450d0 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.872574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.873217 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.873649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.874223 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.878519 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.880163 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f86b-994a-4c1d-a240-f1be9fb1d50a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.913294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1386/2773] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:17.917267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:17.931287 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11689cc8-5140-4b43-b492-154860cbdcfc admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:17.937553 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:17.938343 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:17.938632 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:17.938990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] PATH_INFO: `/v3/projects/fba96335fb174f5eaadda38e253f821d/users/c29c7d3ebe924c07989d54c9ca05bb24/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:17.941315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba96335fb174f5eaadda38e253f821d, user_id=c29c7d3ebe924c07989d54c9ca05bb24, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:17.944133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:17.958318 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1388/2774] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:17 2022] PUT /identity/v3/projects/fba96335fb174f5eaadda38e253f821d/users/c29c7d3ebe924c07989d54c9ca05bb24/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:19.280522 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d32fd-a682-4015-b1bb-6f0396ba3833 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:19.281062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d32fd-a682-4015-b1bb-6f0396ba3833 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:19.281062 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d32fd-a682-4015-b1bb-6f0396ba3833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:19.304334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-032d32fd-a682-4015-b1bb-6f0396ba3833 None None] MFA Rules not processed for user `e7fb2436712f48e792e4ee5a6d33bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:19.306239 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-032d32fd-a682-4015-b1bb-6f0396ba3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:19.404445 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1387/2775] 10.222.0.61 () {58 vars in 967 bytes} [Wed Aug 24 06:00:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:19.470766 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:19.472535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:19.579358 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010782-634c-42bb-a907-8dd3dc7a7d64 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:19.593643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd978a00f91b1435f9662492df2d52fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:19.594416 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:19.594812 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:19.595090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:19.611310 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:19.615715 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:19.649657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1389/2776] 10.222.0.61 () {60 vars in 1384 bytes} [Wed Aug 24 06:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:00:25.623356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e87-349e-4520-af86-096be66829d2 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:25.624704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e87-349e-4520-af86-096be66829d2 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:25.625453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5e87-349e-4520-af86-096be66829d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:25.698582 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3b3a5e87-349e-4520-af86-096be66829d2 None None] MFA Rules not processed for user `c29c7d3ebe924c07989d54c9ca05bb24`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:25.699812 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3b3a5e87-349e-4520-af86-096be66829d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:25.803641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1388/2777] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:25.816580 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:25.999903 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d3b1-7600-431d-9924-4ba0ffc0adb4 service swift] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:26.010198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:26.010892 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:26.011428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:26.011939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:26.062279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:26.113090 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:26.115281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:26.130725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1390/2778] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:27.779081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:27.779547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:27.780121 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:27.799769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:27.810669 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] MFA Rules not processed for user `4726882c02334bf89bc891e9fdabc6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:27.812279 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:27.822752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1389/2779] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:00:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:30.495610 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:30.499554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:30.777703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8dda-70ab-47f9-a93c-4338ea941ca3 service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:30.783367 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:30.784161 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:30.784440 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:30.784775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] PATH_INFO: `/v3/users/0f579c6c6db74e539c21a8a7f1357fce` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:30.786381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f579c6c6db74e539c21a8a7f1357fce)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:30.788517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:30.859493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f579c6c6db74e539c21a8a7f1357fce'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:30.860441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f579c6c6db74e539c21a8a7f1357fce'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:30.880805 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f579c6c6db74e539c21a8a7f1357fce'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:30.881793 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f579c6c6db74e539c21a8a7f1357fce'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:30.885528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:30.896869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f579c6c6db74e539c21a8a7f1357fce'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:30.921859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1391/2780] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:30 2022] DELETE /identity/v3/users/0f579c6c6db74e539c21a8a7f1357fce => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:31.129705 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:31.177982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb78ca-8f09-436d-b2f0-5d5f45b44381 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:31.263238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:31.263894 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:31.264191 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:31.264482 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] PATH_INFO: `/v3/projects/b8baa30905d147c1ae17d09a48298c19` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:31.265660 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8baa30905d147c1ae17d09a48298c19)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:31.267658 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:31.346215 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8baa30905d147c1ae17d09a48298c19', 'request_id': 'req-26f0da76-a202-471e-967e-36ad67ac4bc8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.354053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8baa30905d147c1ae17d09a48298c19', 'request_id': 'req-26f0da76-a202-471e-967e-36ad67ac4bc8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.360136 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8baa30905d147c1ae17d09a48298c19', 'request_id': 'req-26f0da76-a202-471e-967e-36ad67ac4bc8'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.379127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] The token cache is being invalidate because project b8baa30905d147c1ae17d09a48298c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:31.379127 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.380024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.385367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1390/2781] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:31 2022] DELETE /identity/v3/projects/b8baa30905d147c1ae17d09a48298c19 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:31.386538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:31.388175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:31.406505 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14708c-1e47-4a8f-88d8-c1703923d811 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:31.488662 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:31.489309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:31.489591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:31.489905 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] PATH_INFO: `/v3/users/dab39be0bd7042be8bedf44b0dceb0b4` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:31.491064 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab39be0bd7042be8bedf44b0dceb0b4)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:31.493528 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:31.560043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab39be0bd7042be8bedf44b0dceb0b4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.561078 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab39be0bd7042be8bedf44b0dceb0b4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.590012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab39be0bd7042be8bedf44b0dceb0b4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.590940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab39be0bd7042be8bedf44b0dceb0b4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.600221 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab39be0bd7042be8bedf44b0dceb0b4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:31.625669 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1392/2782] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:31 2022] DELETE /identity/v3/users/dab39be0bd7042be8bedf44b0dceb0b4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:31.842889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:31.844733 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:31.860499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0da76-a202-471e-967e-36ad67ac4bc8 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:31.939151 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:31.940049 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:31.940334 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:31.940610 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] PATH_INFO: `/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:31.941748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97bfdc30c0c41f9ba6f8e6ec6f6fb4f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:31.943679 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:31.963011 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:32.003831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97bfdc30c0c41f9ba6f8e6ec6f6fb4f', 'request_id': 'req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:32.012297 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97bfdc30c0c41f9ba6f8e6ec6f6fb4f', 'request_id': 'req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:32.019180 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97bfdc30c0c41f9ba6f8e6ec6f6fb4f', 'request_id': 'req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:32.038455 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] The token cache is being invalidate because project c97bfdc30c0c41f9ba6f8e6ec6f6fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:32.039663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:32.040338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:32.041915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1391/2783] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:31 2022] DELETE /identity/v3/projects/c97bfdc30c0c41f9ba6f8e6ec6f6fb4f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:37.740539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:37.743558 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:37.820704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:37.875327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2ccf0-96d2-413a-a2c5-b8b5cb65d27c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:37.949187 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:37.950279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:37.950741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:37.951213 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:37.954069 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:37.974337 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:37.975869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:37.986235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1393/2784] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:42.032333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:47.982691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=45 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:50.654146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:50.656994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:50.752306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47189b-3d4c-4bfe-8e14-d1c1f2b167fb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:50.756015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:50.757159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:50.757444 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:50.757719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:50.759879 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:50.836198 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:50.837543 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:50.847956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1392/2785] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:01:00.843452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=59 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:47.436201 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:02:47.437629 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:02:47.450167 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b70fe-524d-4f44-a0ea-856b9022df85 service placement] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:02:47.453843 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:02:47.454451 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:02:47.454736 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:02:47.455012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:02:47.456798 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:02:47.561317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:02:47.562797 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243cdb6-c3d5-4343-b9d6-01b3efd40a0c service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:02:47.584593 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1394/2786] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:02:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:02:48.773006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:02:48.781752 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b696-44a2-4b29-b8eb-33031cc65eab service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:02:48.786300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:02:48.786300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:02:48.786588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:02:48.786770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:02:48.788948 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:02:48.808526 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:02:48.809901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:02:48.822000 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1393/2787] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:02:53.139924 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:02:53.140461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:02:53.140461 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:02:53.161093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] MFA Rules not processed for user `92c01f3992404a2dbd4580ffad33d6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:02:53.162529 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:02:53.220596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1395/2788] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:02:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:02:58.816238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=6 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:02.730932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:02.740247 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eaef8-cfb4-437c-82d0-a086714a6ecc service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:02.745884 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:02.746500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:02.746782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:02.747057 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:02.748881 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:02.762112 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:02.763874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:02.774968 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1394/2789] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:03:02.875058 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:02.886248 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ca4ae-ab76-4bcd-b1c9-06d094cb8e16 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:02.889919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:02.890542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:02.890826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:02.891086 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:02.892821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:02.912636 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:02.914253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:02.929687 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1396/2790] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:03:02.994593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:02.996224 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:03.012405 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad36a-c312-4ba5-a99c-ba228c2ce6a4 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:03.017453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:03.018086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:03.018369 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:03.018643 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:03.020452 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:03.034382 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:03.036006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:03.047330 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1395/2791] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:03:04.133792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:04.142950 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac34d5-c97e-47b2-b3f5-6acd19b63b1b service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:04.146616 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:04.147210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:04.147497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:04.147775 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:04.149679 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:04.161149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:04.163020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:04.171982 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1397/2792] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:03:05.705536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:05.707009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:05.723697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2465d-af48-44dc-82a1-90714f6ac666 service placement] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:05.730466 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:05.731077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:05.731504 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:05.731781 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:05.734096 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:05.747899 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:05.749500 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:05.762197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1396/2793] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:03:14.167741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=83 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:15.756723 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=18 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:54.664470 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:03:54.682006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0948a-5a4e-442e-8f22-d2bef0fd4fde service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:03:54.689879 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640894aa402744af861080d8d0d80f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:03:54.690540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:03:54.690823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:03:54.691095 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:03:54.693604 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:03:54.707170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:03:54.708786 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:03:54.720850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1398/2794] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:03:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:02.746423 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:02.760100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e118c3-5012-4937-a170-4efe40d04973 service nova] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:02.765351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:02.765993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:02.766486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:02.766763 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:02.768515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:02.784712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:02.786474 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:02.797977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1397/2795] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:02.819517 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:02.822601 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:02.906253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d97349-f6f8-4608-a8ec-31ca07b098c5 service nova] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:02.911333 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:02.911972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:02.912261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:02.912539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] PATH_INFO: `/v3/users/92c01f3992404a2dbd4580ffad33d6c1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:02.913675 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c01f3992404a2dbd4580ffad33d6c1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:02.915732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:02.962801 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c01f3992404a2dbd4580ffad33d6c1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:02.963452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c01f3992404a2dbd4580ffad33d6c1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:02.975588 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c01f3992404a2dbd4580ffad33d6c1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:02.976218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c01f3992404a2dbd4580ffad33d6c1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:02.983855 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-974ea31c-7b4e-4808-88ba-c5826d18bb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c01f3992404a2dbd4580ffad33d6c1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:02.995814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1399/2796] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:02 2022] DELETE /identity/v3/users/92c01f3992404a2dbd4580ffad33d6c1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:03.168394 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.182083 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e93d-8041-44b8-8031-478a84b47f50 service placement] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.240272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.240904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.241186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.241459 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] PATH_INFO: `/v3/projects/872bd79f407c491ba725d88aa9f85b34` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.242609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=872bd79f407c491ba725d88aa9f85b34)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.244483 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.292326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872bd79f407c491ba725d88aa9f85b34', 'request_id': 'req-93a95738-3272-47d3-9650-a0bd5799d4db'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:03.299091 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872bd79f407c491ba725d88aa9f85b34', 'request_id': 'req-93a95738-3272-47d3-9650-a0bd5799d4db'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:03.304604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872bd79f407c491ba725d88aa9f85b34', 'request_id': 'req-93a95738-3272-47d3-9650-a0bd5799d4db'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:03.317535 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] The token cache is being invalidate because project 872bd79f407c491ba725d88aa9f85b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:03.317863 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:03.318489 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-93a95738-3272-47d3-9650-a0bd5799d4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:03.320018 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1398/2797] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:03 2022] DELETE /identity/v3/projects/872bd79f407c491ba725d88aa9f85b34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:03.324857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.325172 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.325506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.382214 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:03.383329 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:03.415882 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:03.444704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1400/2798] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:03.452429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.452720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.452999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.472649 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:03.473901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:03.481819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1399/2799] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:03.486571 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.496031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff7549-304e-45ea-83bc-99df2cb45d54 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.502383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.502991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.503272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.503546 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.504194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:04:03.504497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.506159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.517567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1401/2800] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:04:03.521851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.531521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da5e5-9f67-4d9f-b549-f4900122c49f None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.536181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.536773 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.537054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.537329 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.537996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.539875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.579720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1400/2801] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:03.584007 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.593949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652d7c-7da2-42b6-ad95-89e8d3668f1f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.650021 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.650548 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.650835 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.651115 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.651739 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.653643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.674452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1402/2802] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:03.678921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.689992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270558-1b03-4d5f-8287-9a5f9a052695 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.694486 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.695079 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.695354 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.695633 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.696269 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.697909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.708516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1401/2803] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:04:03.712573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.722552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a139a4-d604-44ec-8908-f83fb1e7ef72 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.727353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.727961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.728226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.728500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.729131 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.730764 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da5542-70d6-4d6e-9abe-88e465de1fd4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.741941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1403/2804] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:03.745900 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.756866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbae3-d088-4d65-8ad8-f3128aab4c7a admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.761406 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.762077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.762364 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.762644 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] PATH_INFO: `/v3/projects/cad6c47fa1294e7d94c5ce08dc766313/users/14764f4354e24e17a656aea4dc37101f/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.776858 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad6c47fa1294e7d94c5ce08dc766313, user_id=14764f4354e24e17a656aea4dc37101f, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.779509 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:03.792951 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1402/2805] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:03 2022] PUT /identity/v3/projects/cad6c47fa1294e7d94c5ce08dc766313/users/14764f4354e24e17a656aea4dc37101f/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:03.803858 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.804145 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.804421 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.832917 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] MFA Rules not processed for user `14764f4354e24e17a656aea4dc37101f`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:03.834138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:03.898579 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1404/2806] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:03.902993 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:03.909087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:03.966924 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a34a-194a-439b-b037-b7f721efd614 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:03.971750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:03.972367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:03.972652 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:03.972929 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:03.973554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:03.975516 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.001281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1403/2807] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:03 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:04.005363 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.016426 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c64e-55c6-4911-a30b-c0d045960ad0 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.045079 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:04.074631 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.075259 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.076089 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.076364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.077001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.078961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.100695 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1405/2808] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:04 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:04:04.104741 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.115026 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8689-b40a-4f88-b6a8-2ded9d8488fc admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.119754 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.120350 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.120634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.120912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.121549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.123686 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.134031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1404/2809] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:04:04.138750 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.148758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54647-9460-47c2-994b-e9cd4d483154 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.153418 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.154390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.154883 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.155385 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] PATH_INFO: `/v3/projects/34f669f4d1314536a6055e82561c48c2/users/8514c5b9d84f46a6808db6c98b6b8a47/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.171179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f669f4d1314536a6055e82561c48c2, user_id=8514c5b9d84f46a6808db6c98b6b8a47, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.173837 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.187752 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1406/2810] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:04 2022] PUT /identity/v3/projects/34f669f4d1314536a6055e82561c48c2/users/8514c5b9d84f46a6808db6c98b6b8a47/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:04.192140 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.202709 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee003c-5154-4f34-bafc-fae6682a746b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.258351 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.258978 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.259261 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.259528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.260161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.261740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ebfab-1db0-465e-bb0c-31317a980ec7 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.271901 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1405/2811] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:04.276210 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.286353 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ef02-fc2e-4533-8462-df79aa608ee4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.291252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.291933 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.292218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.292496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] PATH_INFO: `/v3/projects/34f669f4d1314536a6055e82561c48c2/users/8514c5b9d84f46a6808db6c98b6b8a47/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.294475 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f669f4d1314536a6055e82561c48c2, user_id=8514c5b9d84f46a6808db6c98b6b8a47, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.297124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.307978 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1407/2812] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:04 2022] PUT /identity/v3/projects/34f669f4d1314536a6055e82561c48c2/users/8514c5b9d84f46a6808db6c98b6b8a47/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:04.320196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.320495 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.320778 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.348232 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] MFA Rules not processed for user `8514c5b9d84f46a6808db6c98b6b8a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:04.349461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:04.413076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:04.417788 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1406/2813] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:04.428795 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:04.430754 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:04.510595 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211da87-0d62-4b53-9b24-d803b77ed1b4 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:04.514285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:04.515255 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:04.515547 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:04.515824 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:04.525392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:04.527751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25a45-f612-42a2-982c-110e300c5cbe service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:04.539106 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1408/2814] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:04.952421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:05.013553 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb07af2-72a7-4574-8ad0-06e537257a95 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:05.018100 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:05.018720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:05.018999 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:05.019291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] PATH_INFO: `/v3/users/14764f4354e24e17a656aea4dc37101f` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:05.020656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14764f4354e24e17a656aea4dc37101f)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:05.022588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:05.068383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14764f4354e24e17a656aea4dc37101f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.069032 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14764f4354e24e17a656aea4dc37101f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.069664 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14764f4354e24e17a656aea4dc37101f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.084288 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14764f4354e24e17a656aea4dc37101f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.091962 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14764f4354e24e17a656aea4dc37101f'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.103954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1407/2815] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:04 2022] DELETE /identity/v3/users/14764f4354e24e17a656aea4dc37101f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:05.108904 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:05.109366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:05.109493 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:05.127823 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:05.129005 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:05.186833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1409/2816] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:04:05.196348 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:05.197744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:05.254054 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda33714-7fa5-4153-a521-7aae3dbf1336 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:05.257640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:05.258272 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:05.258552 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:05.258824 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:05.268174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:05.269594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:05.279427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1408/2817] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:04:05.542540 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:05.543967 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:05.557914 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1bd3-421d-424b-a985-d498a7d87344 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:05.563320 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:05.563985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:05.564273 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:05.564573 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] PATH_INFO: `/v3/projects/cad6c47fa1294e7d94c5ce08dc766313` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:05.565691 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad6c47fa1294e7d94c5ce08dc766313)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:05.567666 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:05.569340 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:05.620059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad6c47fa1294e7d94c5ce08dc766313', 'request_id': 'req-5bea478a-8641-42ec-b82a-b606f0bb93ab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.627735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad6c47fa1294e7d94c5ce08dc766313', 'request_id': 'req-5bea478a-8641-42ec-b82a-b606f0bb93ab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.634031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad6c47fa1294e7d94c5ce08dc766313', 'request_id': 'req-5bea478a-8641-42ec-b82a-b606f0bb93ab'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.644734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] The token cache is being invalidate because project cad6c47fa1294e7d94c5ce08dc766313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:05.645645 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.646510 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.648844 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1410/2818] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:05 2022] DELETE /identity/v3/projects/cad6c47fa1294e7d94c5ce08dc766313 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:05.653010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:05.663148 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7711f9-e0a2-4a94-a147-73834d9a1d79 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:05.681651 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:05.721168 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:05.721719 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:05.722040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:05.722320 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] PATH_INFO: `/v3/users/8514c5b9d84f46a6808db6c98b6b8a47` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:05.723454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8514c5b9d84f46a6808db6c98b6b8a47)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:05.725358 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:05.770663 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8514c5b9d84f46a6808db6c98b6b8a47'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.771323 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8514c5b9d84f46a6808db6c98b6b8a47'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.771936 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8514c5b9d84f46a6808db6c98b6b8a47'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.784436 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8514c5b9d84f46a6808db6c98b6b8a47'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.791040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-5469b347-baa5-4aa6-a8c9-121809e373e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8514c5b9d84f46a6808db6c98b6b8a47'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:05.805337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1409/2819] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:05 2022] DELETE /identity/v3/users/8514c5b9d84f46a6808db6c98b6b8a47 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:06.082289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.083821 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:06.097619 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea478a-8641-42ec-b82a-b606f0bb93ab admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.153198 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.154452 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.154734 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.155009 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] PATH_INFO: `/v3/projects/34f669f4d1314536a6055e82561c48c2` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.156117 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f669f4d1314536a6055e82561c48c2)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.158057 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.206999 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f669f4d1314536a6055e82561c48c2', 'request_id': 'req-50b8ee08-47d5-4bd6-941f-1073675e2f02'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:06.215660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f669f4d1314536a6055e82561c48c2', 'request_id': 'req-50b8ee08-47d5-4bd6-941f-1073675e2f02'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:06.222031 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f669f4d1314536a6055e82561c48c2', 'request_id': 'req-50b8ee08-47d5-4bd6-941f-1073675e2f02'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:06.232808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] The token cache is being invalidate because project 34f669f4d1314536a6055e82561c48c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:06.233101 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:06.233746 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-50b8ee08-47d5-4bd6-941f-1073675e2f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:06.235270 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1411/2820] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:06 2022] DELETE /identity/v3/projects/34f669f4d1314536a6055e82561c48c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:06.240280 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.240828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.240828 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.260530 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:06.261729 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:06.319599 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1410/2821] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:06.327663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.327949 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.328224 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.347783 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:06.348972 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:06.357947 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1412/2822] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:06.362312 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.372076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25afd6a-1d94-4595-a853-9e582ddc83b7 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.376689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.377290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.377574 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.377886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.378544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:04:06.378851 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.380558 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.391915 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1411/2823] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:04:06.396179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.405813 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a9d3-0193-41b2-bdf3-c9c1811ee2b2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.410428 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.411032 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.411316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.411591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.412209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.414124 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.425533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:06.442665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1413/2824] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:06.446720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.456847 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878873a4-0dce-424d-ac0b-4a48e2d484a6 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.483326 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:06.513982 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.514598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.514890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.515171 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.515809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.517726 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.539002 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1412/2825] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:06.543044 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.553985 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ff60-a324-4333-909c-1842ff098b98 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.558865 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.559469 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.559751 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.560192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.560830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.562463 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.572390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1414/2826] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:06.576384 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.586525 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0e20-643c-462f-bfcb-c0233e73c993 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.591711 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.592310 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.592594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.592875 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.593521 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.595154 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62b347-9d0c-4bdc-969b-ab185d282e66 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.605932 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1413/2827] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:06.610731 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.620591 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb300-adc1-44e1-982f-e4fc2694b1ab admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.625166 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.625836 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.626120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.626392 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] PATH_INFO: `/v3/projects/f6804f30b13e453e884a8d75035b7f54/users/3d19d532f64a4b74b997e4fedcfa5124/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.640455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6804f30b13e453e884a8d75035b7f54, user_id=3d19d532f64a4b74b997e4fedcfa5124, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.643141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.656802 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1415/2828] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:06 2022] PUT /identity/v3/projects/f6804f30b13e453e884a8d75035b7f54/users/3d19d532f64a4b74b997e4fedcfa5124/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:06.667161 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.667454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.667734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.695626 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] MFA Rules not processed for user `3d19d532f64a4b74b997e4fedcfa5124`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:06.696831 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:06.759209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1414/2829] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:06.764413 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.824745 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c49c3-2e61-402b-a5f3-61a51e5a0c3f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.829936 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.830541 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.830826 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.831103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.831735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.833621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.859640 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1416/2830] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:06.863928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.874556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5bd0d-d7e7-4e9a-9839-e0a322904d47 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.930318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.930928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.931214 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.931491 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.932108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.934053 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.955033 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1415/2831] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:06 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:06.959008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:06.969718 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092bbd4-31b4-4176-961e-99ddd2f5ae5e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:06.974316 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:06.974907 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:06.975189 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:06.975464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:06.976096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:06.977833 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:06.988832 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1417/2832] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:06.992975 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:07.003196 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7cad5-7a0c-4d96-a5cf-1797bd3906dd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:07.008402 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:07.009074 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.009361 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.009641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] PATH_INFO: `/v3/projects/9e6f08ac698b4d969bae91454074a6ba/users/ca6c3fd1701f452ca04efd349549614e/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.025640 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6f08ac698b4d969bae91454074a6ba, user_id=ca6c3fd1701f452ca04efd349549614e, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:07.028306 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:07.041634 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1416/2833] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:06 2022] PUT /identity/v3/projects/9e6f08ac698b4d969bae91454074a6ba/users/ca6c3fd1701f452ca04efd349549614e/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:07.045741 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:07.055934 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d3a0-4127-47d6-8a12-f36e26020cb8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:07.111496 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:07.112097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.112384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.112660 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.113297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:07.115013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d8a1-ac71-491c-bdfe-3f9f28293bc0 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:07.124973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1418/2834] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:07.129270 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:07.134672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:07.141735 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec4a95-e4d5-408d-b1a1-edb033f535ab admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:07.146744 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:07.147400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.147683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.147963 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] PATH_INFO: `/v3/projects/9e6f08ac698b4d969bae91454074a6ba/users/ca6c3fd1701f452ca04efd349549614e/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.149943 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6f08ac698b4d969bae91454074a6ba, user_id=ca6c3fd1701f452ca04efd349549614e, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:07.152544 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:07.163022 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1417/2835] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:07 2022] PUT /identity/v3/projects/9e6f08ac698b4d969bae91454074a6ba/users/ca6c3fd1701f452ca04efd349549614e/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:07.174304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.174781 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.174880 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.203511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] MFA Rules not processed for user `ca6c3fd1701f452ca04efd349549614e`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:07.204717 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:07.217327 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:07.274041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1419/2836] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:07.285294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:07.287015 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:07.347296 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d444-ad89-4ec5-97c0-44ab1ea51472 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:07.351101 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:07.351740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.352023 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.352303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.361210 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:07.362672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:07.371927 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1418/2837] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:07.446341 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:07.456670 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17edc1-6c88-4231-bb38-8c026170de43 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:07.460657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:07.461265 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:07.461552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:07.461866 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:07.518225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:07.519647 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34ff5c-1409-47ff-8650-127fa6dbcf6a service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:07.528481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1420/2838] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:17.367809 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:17.524518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=50 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:22.543798 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:22.624654 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bc512-20c2-4a94-b294-0364c87dadd4 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:22.629683 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:22.630374 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:22.630725 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:22.630922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] PATH_INFO: `/v3/users/3d19d532f64a4b74b997e4fedcfa5124` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:22.632103 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d19d532f64a4b74b997e4fedcfa5124)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:22.634076 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:22.698501 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d19d532f64a4b74b997e4fedcfa5124'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:22.699263 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d19d532f64a4b74b997e4fedcfa5124'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:22.701271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d19d532f64a4b74b997e4fedcfa5124'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:22.716010 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d19d532f64a4b74b997e4fedcfa5124'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:22.725710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d19d532f64a4b74b997e4fedcfa5124'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:22.743169 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1419/2839] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:22 2022] DELETE /identity/v3/users/3d19d532f64a4b74b997e4fedcfa5124 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:22.749497 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:22.750083 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:22.750455 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:22.780511 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:22.782194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:22.861942 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1421/2840] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:22.874542 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:22.876043 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:22.939283 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528606f5-0eb6-4dce-a601-daeee8c9627b admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:22.943126 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:22.943750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:22.944037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:22.944314 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:22.955146 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:22.956770 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:22.968429 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1420/2841] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:23.396448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:23.398171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:23.421347 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f089bb-73ea-49c2-b997-4bc19ecee3ec None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:23.434435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:23.435112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:23.435380 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:23.435653 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] PATH_INFO: `/v3/projects/f6804f30b13e453e884a8d75035b7f54` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:23.436804 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6804f30b13e453e884a8d75035b7f54)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:23.438778 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:23.511252 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6804f30b13e453e884a8d75035b7f54', 'request_id': 'req-0941eb1b-b251-4898-a33d-311f0b52bf2c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.519941 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6804f30b13e453e884a8d75035b7f54', 'request_id': 'req-0941eb1b-b251-4898-a33d-311f0b52bf2c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.528550 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6804f30b13e453e884a8d75035b7f54', 'request_id': 'req-0941eb1b-b251-4898-a33d-311f0b52bf2c'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.540563 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] The token cache is being invalidate because project f6804f30b13e453e884a8d75035b7f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:23.540863 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.541535 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.543138 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1422/2842] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:23 2022] DELETE /identity/v3/projects/f6804f30b13e453e884a8d75035b7f54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:23.548380 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:23.560837 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778f56c-369f-458d-9d8f-54a83f83785a service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:23.581476 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:23.627547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:23.628181 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:23.628467 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:23.628740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] PATH_INFO: `/v3/users/ca6c3fd1701f452ca04efd349549614e` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:23.630090 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6c3fd1701f452ca04efd349549614e)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:23.632036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:23.681528 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6c3fd1701f452ca04efd349549614e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.682211 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6c3fd1701f452ca04efd349549614e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.682902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6c3fd1701f452ca04efd349549614e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.700300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6c3fd1701f452ca04efd349549614e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.710108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-1c9cfd9e-416a-4bc1-b4e0-d8e17dcda7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6c3fd1701f452ca04efd349549614e'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:23.724453 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1421/2843] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:23 2022] DELETE /identity/v3/users/ca6c3fd1701f452ca04efd349549614e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:24.064438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.066144 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:24.085744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941eb1b-b251-4898-a33d-311f0b52bf2c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.154006 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.154655 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.154948 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.155209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] PATH_INFO: `/v3/projects/9e6f08ac698b4d969bae91454074a6ba` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.156364 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6f08ac698b4d969bae91454074a6ba)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.158294 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.195120 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:24.213618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6f08ac698b4d969bae91454074a6ba', 'request_id': 'req-1d8c05ea-58a6-4e89-a254-c35437f68b4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:24.224290 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6f08ac698b4d969bae91454074a6ba', 'request_id': 'req-1d8c05ea-58a6-4e89-a254-c35437f68b4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:24.231483 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6f08ac698b4d969bae91454074a6ba', 'request_id': 'req-1d8c05ea-58a6-4e89-a254-c35437f68b4d'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:24.242289 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] The token cache is being invalidate because project 9e6f08ac698b4d969bae91454074a6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:24.242577 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:24.243226 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1d8c05ea-58a6-4e89-a254-c35437f68b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:24.244696 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1423/2844] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:24 2022] DELETE /identity/v3/projects/9e6f08ac698b4d969bae91454074a6ba => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:24.249992 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.250276 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.250551 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.269796 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:24.270994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:24.330318 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1422/2845] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:24.338175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.338464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.338744 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.359665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:24.360849 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:24.368779 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1424/2846] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:24.372930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.383035 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4c467-0779-42d7-ac37-5bfcfe380f78 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.387511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.388105 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.388462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.388743 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.389383 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:04:24.389688 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.391338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.402547 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1423/2847] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:04:24.407188 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.416411 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822a59-3c01-4e59-957e-1f4518084eac None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.421536 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.422155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.422435 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.422701 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.423315 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.425175 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.452085 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1425/2848] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:24.456587 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.467593 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97856e-f31a-42f6-b7cd-f1581d41c1b4 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.495819 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:24.526795 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.527404 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.527692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.527973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.528613 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.531078 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.552355 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1424/2849] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:24.556860 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.567656 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3e433-a443-45f1-a6b9-8b565b9d2eaa admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.572244 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.572851 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.573139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.573419 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.574109 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.575705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.588474 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1426/2850] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:24.592609 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.602890 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263e42-2f59-4069-b75a-4e9f32f1df40 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.608036 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.608630 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.608913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.609185 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.609854 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.611437 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a10a5-9238-40a0-b951-671d73a53fb2 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.621913 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1425/2851] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:24.626841 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.636830 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec0bb-3cb9-4eb5-b6e0-95fba2895cb2 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.641930 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.642592 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.642859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.643135 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] PATH_INFO: `/v3/projects/976a02a9d02d499b99f804624e79da2d/users/b72ba64d7eae4a7d85218c2e896b24d4/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.657103 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976a02a9d02d499b99f804624e79da2d, user_id=b72ba64d7eae4a7d85218c2e896b24d4, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.659792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.672668 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1427/2852] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:24 2022] PUT /identity/v3/projects/976a02a9d02d499b99f804624e79da2d/users/b72ba64d7eae4a7d85218c2e896b24d4/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:24.684295 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.684588 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.684866 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.713864 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] MFA Rules not processed for user `b72ba64d7eae4a7d85218c2e896b24d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:24.715077 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:24.778229 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1426/2853] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:24.783448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.844989 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807656-d3ac-46ef-b0bb-b179630018b6 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.850285 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.850991 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.851280 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.851556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.852179 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.854082 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.881309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1428/2854] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:24.885333 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.896490 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017fce1-e7ab-427c-95b4-dc8e4f3d9eed None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.951826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.952432 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.952712 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.952983 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] PATH_INFO: `/v3/users` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.953612 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.955541 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:24.975930 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1427/2855] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:24 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:24.979973 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:24.990787 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08121a-b846-4b77-bac0-77878e65fcb9 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:24.995372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:24.995975 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:24.996262 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:24.996542 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:24.997182 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:24.999441 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.009808 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1429/2856] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:04:25.013928 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.023786 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0fda-592f-43bf-b6e4-046f4f7126fd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.028291 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.028956 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.029238 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.029511 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] PATH_INFO: `/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26/users/2c0a4671197447089747ec35f9adb962/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.043697 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab8f4c8e7614f13a4be3ecae9255a26, user_id=2c0a4671197447089747ec35f9adb962, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.046886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.059825 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1428/2857] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:25 2022] PUT /identity/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26/users/2c0a4671197447089747ec35f9adb962/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:04:25.064279 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.074196 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefab01-3ea0-42c6-a2eb-20e6e0f7c69a admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.095422 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:25.132791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.133403 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.133690 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.134094 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.134737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.136365 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8d0ec-d5ac-43df-a2a1-b51050a90f44 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.145962 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1430/2858] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:25.150088 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.156061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:25.163155 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759259-6d37-47ba-b924-fd8eef9d26df admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.168555 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.169285 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.169702 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.170566 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] PATH_INFO: `/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26/users/2c0a4671197447089747ec35f9adb962/roles/e815260061204037a403daee014c9531` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.172570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab8f4c8e7614f13a4be3ecae9255a26, user_id=2c0a4671197447089747ec35f9adb962, role_id=e815260061204037a403daee014c9531)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.175277 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.189861 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1429/2859] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:25 2022] PUT /identity/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26/users/2c0a4671197447089747ec35f9adb962/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:25.200068 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.200366 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.200652 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.230155 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] MFA Rules not processed for user `2c0a4671197447089747ec35f9adb962`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:25.231379 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:25.303110 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1431/2860] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:25.315874 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.317794 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:25.403094 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa89b-dc88-4d56-bf31-1afb01c33785 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.406730 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.407386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.407745 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.408086 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.418037 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.419531 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee64ac2-3f6f-4f32-a917-9473f54924d1 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.429009 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1430/2861] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:25.458209 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.521352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a018209-ecf6-423b-95f9-d32b5df5d3ef None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.526153 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.526788 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.527074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.527352 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] PATH_INFO: `/v3/users/b72ba64d7eae4a7d85218c2e896b24d4` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.528490 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72ba64d7eae4a7d85218c2e896b24d4)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.530459 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.584635 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72ba64d7eae4a7d85218c2e896b24d4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:25.585439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72ba64d7eae4a7d85218c2e896b24d4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:25.586874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:25.601665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72ba64d7eae4a7d85218c2e896b24d4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:25.602556 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72ba64d7eae4a7d85218c2e896b24d4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:25.612376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72ba64d7eae4a7d85218c2e896b24d4'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:25.624726 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1432/2862] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:25 2022] DELETE /identity/v3/users/b72ba64d7eae4a7d85218c2e896b24d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:25.629708 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.630220 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.630473 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.650087 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:25.651287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:25.711303 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1431/2863] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:25.721170 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:25.722758 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:25.784954 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b592-e798-4024-bb05-966b726ed8bd admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:25.788650 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:25.789437 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:25.789722 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:25.790029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:25.799309 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:25.800767 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:25.810657 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1433/2864] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:04:26.217869 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:26.219400 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:26.231840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aa5fb-0afe-4ba3-9f4a-5c96bcf1c8ef None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:26.237152 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:26.237826 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:26.238111 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:26.238386 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] PATH_INFO: `/v3/projects/976a02a9d02d499b99f804624e79da2d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:26.239789 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976a02a9d02d499b99f804624e79da2d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:26.241701 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:26.298024 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976a02a9d02d499b99f804624e79da2d', 'request_id': 'req-f701f394-1803-42c9-a345-bc33fd104ef1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.304892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976a02a9d02d499b99f804624e79da2d', 'request_id': 'req-f701f394-1803-42c9-a345-bc33fd104ef1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.311724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976a02a9d02d499b99f804624e79da2d', 'request_id': 'req-f701f394-1803-42c9-a345-bc33fd104ef1'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.324973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] The token cache is being invalidate because project 976a02a9d02d499b99f804624e79da2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:26.325218 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.326175 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.327716 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1432/2865] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:26 2022] DELETE /identity/v3/projects/976a02a9d02d499b99f804624e79da2d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:26.331925 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:26.342988 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879636-3cfa-4218-a27e-f1f362f9d20c service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:26.422014 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:26.422759 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:26.423099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:26.423383 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] PATH_INFO: `/v3/users/2c0a4671197447089747ec35f9adb962` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:26.424622 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0a4671197447089747ec35f9adb962)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:26.426792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:26.485792 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0a4671197447089747ec35f9adb962'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.486500 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0a4671197447089747ec35f9adb962'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.501296 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0a4671197447089747ec35f9adb962'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.502133 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0a4671197447089747ec35f9adb962'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.508582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:26.513013 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-0bd056e7-7718-46a1-b06d-cf4c38b92054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0a4671197447089747ec35f9adb962'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:26.533705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1434/2866] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:26 2022] DELETE /identity/v3/users/2c0a4671197447089747ec35f9adb962 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:26.830676 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:26.833045 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:26.851984 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f394-1803-42c9-a345-bc33fd104ef1 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:26.868974 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:26.931782 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:26.932575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:26.932967 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:26.933367 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] PATH_INFO: `/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:26.934769 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab8f4c8e7614f13a4be3ecae9255a26)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:26.936969 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:26.994271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab8f4c8e7614f13a4be3ecae9255a26', 'request_id': 'req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:27.001802 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab8f4c8e7614f13a4be3ecae9255a26', 'request_id': 'req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:27.009536 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab8f4c8e7614f13a4be3ecae9255a26', 'request_id': 'req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:27.023736 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] The token cache is being invalidate because project dab8f4c8e7614f13a4be3ecae9255a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:27.024124 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:27.024832 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-c83e2cb0-6a6c-4c47-a18e-23a38cb85cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:27.026468 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1433/2867] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:26 2022] DELETE /identity/v3/projects/dab8f4c8e7614f13a4be3ecae9255a26 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:27.032096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.032468 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.032848 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.055388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:27.056909 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:27.130940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1435/2868] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:27.131917 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.132204 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.132478 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.153575 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:27.155805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:27.164158 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1434/2869] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:04:27.168406 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.178923 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc1550-691c-4891-943b-872262db53e2 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.184874 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.185554 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.185940 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.186222 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.186902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:04:27.187235 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.188877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.203389 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1436/2870] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:04:27.207570 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.217926 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315564e9-709d-4b5e-93d2-8d7a9129222a None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.223108 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.223897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.224281 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.224656 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.225412 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.227497 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.261734 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1435/2871] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:04:27.265803 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.276538 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2700d-d106-45b1-81fa-42b58e10e18e admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.352119 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.352997 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.353506 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.353920 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.354735 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.356912 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.383258 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1437/2872] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:04:27.387250 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.397714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d57ee4-e45e-4602-ad2e-e1ad8cc640b9 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.402844 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.403508 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.403793 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.404772 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.405805 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.407287 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.419408 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1436/2873] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:04:27.424139 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.435857 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce64f5b-dbfb-491e-817c-a989b2e1bbbb admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.441381 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.441729 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.442253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.442533 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.443576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.445096 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e949d7-c230-43e6-b1ee-7fd8fbc74f73 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.457331 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1438/2874] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:27.461390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.471981 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4289-6476-456b-940a-9b001604f4cd admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.478764 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.479461 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.479747 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.480028 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] PATH_INFO: `/v3/projects/a0bda228723e40ea883dd767604ba333/users/efcd0bf0e6484b0b9f78ac48c8a02b12/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.498294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bda228723e40ea883dd767604ba333, user_id=efcd0bf0e6484b0b9f78ac48c8a02b12, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.501031 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.519186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1437/2875] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:27 2022] PUT /identity/v3/projects/a0bda228723e40ea883dd767604ba333/users/efcd0bf0e6484b0b9f78ac48c8a02b12/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:27.591959 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.592448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.592742 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.636562 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] MFA Rules not processed for user `efcd0bf0e6484b0b9f78ac48c8a02b12`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:27.639218 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:27.694714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:27.728476 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1439/2876] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:27.729720 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.783203 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:27.802977 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b36f-62c5-46cc-a0de-0de8bfa57b24 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.807985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.808672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.808961 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.809244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.809902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.811846 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.840892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1438/2877] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:27.845644 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.856705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b14028-e520-4595-bd02-ebe8b76f0779 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.916846 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.917393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.917705 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.917994 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.918641 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.921118 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.943714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1440/2878] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:27 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:27.947876 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:27.958564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd855c7-17b1-4848-a691-b14fafa0357c admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:27.964458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:27.965174 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:27.965496 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:27.965840 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:27.966619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:27.968458 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:27.984829 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1439/2879] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:27.989191 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.000001 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b071-728e-446a-8b1a-621a584c5006 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.004760 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.005576 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.005899 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.006184 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] PATH_INFO: `/v3/projects/feb9175e31624607bf9d0e22750d37b9/users/e3784fc5e98f4f05ad43e9f7c4b3c496/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.024530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9175e31624607bf9d0e22750d37b9, user_id=e3784fc5e98f4f05ad43e9f7c4b3c496, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.028039 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.045711 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1441/2880] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:27 2022] PUT /identity/v3/projects/feb9175e31624607bf9d0e22750d37b9/users/e3784fc5e98f4f05ad43e9f7c4b3c496/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:28.049748 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.061954 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8404a9-7aa0-4826-a29d-47593651cd84 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.131801 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.132427 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.132715 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.132996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.133714 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.135359 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ab0fd-d234-4937-b14c-f4b87bbe5a09 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.146362 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1440/2881] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:28.151043 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.163304 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3cbc9-dde2-4bda-ac36-fc10f38d1a8f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.168607 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.169429 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] REQUEST_METHOD: `PUT` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.170317 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.170596 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] PATH_INFO: `/v3/projects/feb9175e31624607bf9d0e22750d37b9/users/e3784fc5e98f4f05ad43e9f7c4b3c496/roles/e815260061204037a403daee014c9531` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.172567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9175e31624607bf9d0e22750d37b9, user_id=e3784fc5e98f4f05ad43e9f7c4b3c496, role_id=e815260061204037a403daee014c9531)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.175388 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.186913 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1442/2882] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:28 2022] PUT /identity/v3/projects/feb9175e31624607bf9d0e22750d37b9/users/e3784fc5e98f4f05ad43e9f7c4b3c496/roles/e815260061204037a403daee014c9531 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:28.197166 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.197462 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.197740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.229107 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] MFA Rules not processed for user `e3784fc5e98f4f05ad43e9f7c4b3c496`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:28.230481 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:28.330337 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1441/2883] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:28.340825 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.343393 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:28.418466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42465579-a707-4eeb-a2a0-9cf075cbabce admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.422598 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.423239 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.423634 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.424012 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.435693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.437733 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06f10-d46b-4b3f-8ef1-9ee57ade5733 service cinder] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.454552 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1443/2884] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:28.525839 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.572579 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:28.597556 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa3a7-286a-461a-afdf-df26dc50dbd6 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.602346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.603001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.603316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.603604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] PATH_INFO: `/v3/users/efcd0bf0e6484b0b9f78ac48c8a02b12` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.604777 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=efcd0bf0e6484b0b9f78ac48c8a02b12)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.606757 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.657246 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcd0bf0e6484b0b9f78ac48c8a02b12'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:28.657938 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcd0bf0e6484b0b9f78ac48c8a02b12'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:28.658564 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcd0bf0e6484b0b9f78ac48c8a02b12'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:28.672994 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcd0bf0e6484b0b9f78ac48c8a02b12'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:28.680460 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcd0bf0e6484b0b9f78ac48c8a02b12'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:28.694040 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1442/2885] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:28 2022] DELETE /identity/v3/users/efcd0bf0e6484b0b9f78ac48c8a02b12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:28.698374 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.698663 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.698961 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.720272 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:28.721525 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:28.765545 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:28.801990 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1444/2886] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:28.813872 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:28.816290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:28.890641 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e651c-c4cb-43ee-8165-f2fea6d7afeb admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:28.894554 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:28.895294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:28.895680 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:28.896081 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:28.911016 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:28.912889 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:28.925244 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1443/2887] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:04:29.060819 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:29.062438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:29.201567 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288900b-8b84-4a44-94e7-cb3e8f93edc4 None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:29.207618 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:29.208297 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:29.208613 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:29.209004 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:29.210918 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:29.225169 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:29.226810 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:29.237438 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1445/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:29.429925 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:29.431767 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:29.445236 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d383fa-ca67-41ae-b297-96bc91eaa496 service neutron] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:29.450657 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:29.452418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:29.452418 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:29.452674 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] PATH_INFO: `/v3/projects/a0bda228723e40ea883dd767604ba333` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:29.453678 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bda228723e40ea883dd767604ba333)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:29.455615 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:29.506694 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bda228723e40ea883dd767604ba333', 'request_id': 'req-a900d426-9652-4160-becc-d0a576da9447'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.513122 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bda228723e40ea883dd767604ba333', 'request_id': 'req-a900d426-9652-4160-becc-d0a576da9447'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.514922 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:29.520810 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bda228723e40ea883dd767604ba333', 'request_id': 'req-a900d426-9652-4160-becc-d0a576da9447'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.535044 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] The token cache is being invalidate because project a0bda228723e40ea883dd767604ba333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:29.535356 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.535980 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.537488 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1444/2889] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:29 2022] DELETE /identity/v3/projects/a0bda228723e40ea883dd767604ba333 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:29.541466 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:29.552944 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2192-6678-49a2-b170-c3aaafa4de46 service placement] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:29.614361 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:29.615000 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:29.615282 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:29.615561 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] PATH_INFO: `/v3/users/e3784fc5e98f4f05ad43e9f7c4b3c496` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:29.616702 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3784fc5e98f4f05ad43e9f7c4b3c496)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:29.618648 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:29.667194 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3784fc5e98f4f05ad43e9f7c4b3c496'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.667850 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3784fc5e98f4f05ad43e9f7c4b3c496'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.680448 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3784fc5e98f4f05ad43e9f7c4b3c496'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.681335 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3784fc5e98f4f05ad43e9f7c4b3c496'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.686901 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:29.692719 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-6050702e-eb21-4e30-b7de-c340b0fcbf3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3784fc5e98f4f05ad43e9f7c4b3c496'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:29.706555 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1446/2890] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:29 2022] DELETE /identity/v3/users/e3784fc5e98f4f05ad43e9f7c4b3c496 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:29.977321 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:29.978902 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:30.003290 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900d426-9652-4160-becc-d0a576da9447 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.065594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.066271 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.066560 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.066862 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] PATH_INFO: `/v3/projects/feb9175e31624607bf9d0e22750d37b9` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.067995 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb9175e31624607bf9d0e22750d37b9)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.069973 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.127184 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb9175e31624607bf9d0e22750d37b9', 'request_id': 'req-98c92076-af05-4e5e-819d-888f8ec53e42'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:30.133791 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb9175e31624607bf9d0e22750d37b9', 'request_id': 'req-98c92076-af05-4e5e-819d-888f8ec53e42'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:30.141403 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb9175e31624607bf9d0e22750d37b9', 'request_id': 'req-98c92076-af05-4e5e-819d-888f8ec53e42'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:30.157494 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] The token cache is being invalidate because project feb9175e31624607bf9d0e22750d37b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:30.157912 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:30.158603 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-98c92076-af05-4e5e-819d-888f8ec53e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:30.160692 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1445/2891] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:29 2022] DELETE /identity/v3/projects/feb9175e31624607bf9d0e22750d37b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:30.166609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.166902 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.167192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.194725 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:30.196036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:30.276698 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1447/2892] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:30.284565 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.284957 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.285345 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.308965 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:30.310242 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:30.318750 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1446/2893] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:30.323091 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.333530 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806671b-ddec-46c8-bec7-ac29ea53085f None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.338454 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.339097 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.339384 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.339665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.340326 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:04:30.340639 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.343159 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.359303 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1448/2894] 10.222.0.61 () {58 vars in 1153 bytes} [Wed Aug 24 06:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:04:30.360419 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.369953 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d88ae-a6ba-4265-a5be-38ff25a40c15 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.376979 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.377598 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.377909 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.378186 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.378821 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.380849 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.411987 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1447/2895] 10.222.0.61 () {60 vars in 1153 bytes} [Wed Aug 24 06:04:30 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:30.413405 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.423763 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f489-1692-4bb6-9108-2a3b7240ff1f admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.483627 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.484149 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.484434 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.484773 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.485522 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.487539 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.509939 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1449/2896] 10.222.0.61 () {60 vars in 1144 bytes} [Wed Aug 24 06:04:30 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:04:30.516434 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.527454 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd3ea-4546-495a-abe0-c7a674123b23 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.532387 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.532996 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.533284 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.533567 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] PATH_INFO: `/v3/roles` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.534262 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.536001 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.546322 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1448/2897] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:04:30.550582 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.562074 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad487-338b-4182-a7bc-ab98bb3f13a8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.571387 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.572609 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.572895 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.573171 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.573859 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.575518 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3490b1-fa82-4efe-aef4-4d1969e35c73 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.588464 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1450/2898] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 24 06:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:04:30.592572 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.602704 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024465b-bbb4-4a7f-ae1a-6406ba5f3480 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.607344 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.608006 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.608294 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.608594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] PATH_INFO: `/v3/projects/0117df7e7e694db89ee82058582db4db/users/a4b7e1ddbe004c77ad6f14d8af089ced/roles/18d95dfd99d24cd5b5cadd6cf43b7154` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.627887 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0117df7e7e694db89ee82058582db4db, user_id=a4b7e1ddbe004c77ad6f14d8af089ced, role_id=18d95dfd99d24cd5b5cadd6cf43b7154)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.630300 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.649619 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1449/2899] 10.222.0.61 () {60 vars in 1483 bytes} [Wed Aug 24 06:04:30 2022] PUT /identity/v3/projects/0117df7e7e694db89ee82058582db4db/users/a4b7e1ddbe004c77ad6f14d8af089ced/roles/18d95dfd99d24cd5b5cadd6cf43b7154 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:30.659693 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] REQUEST_METHOD: `POST` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.659986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.660267 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.693814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.auth.core [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] MFA Rules not processed for user `a4b7e1ddbe004c77ad6f14d8af089ced`. Rule list: `[]` (Enabled: `True`). {{(pid=82399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:30.693814 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:30.744791 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:30.770932 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1451/2900] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:30.783538 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:30.785949 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:30.803691 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:30.874549 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8605-7c44-40b1-8db4-fdd4c69c2f02 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:30.878653 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ccf6d1dd8cc49b385c569206fcfdbe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:30.879475 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] REQUEST_METHOD: `GET` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:30.879762 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:30.880061 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:30.891594 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:30.893583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:30.903370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1450/2901] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:32.254215 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:32.255643 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:32.346036 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dcd3-2adc-41cd-9939-8f04bb892b3d None None] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:32.351756 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:32.352671 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:32.352986 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:32.353274 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] PATH_INFO: `/v3/users/4726882c02334bf89bc891e9fdabc6a1` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:32.355400 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4726882c02334bf89bc891e9fdabc6a1)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:32.357877 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:32.415029 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4726882c02334bf89bc891e9fdabc6a1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.415699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4726882c02334bf89bc891e9fdabc6a1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.429010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4726882c02334bf89bc891e9fdabc6a1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.429704 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4726882c02334bf89bc891e9fdabc6a1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.439141 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4726882c02334bf89bc891e9fdabc6a1'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.452059 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1452/2902] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:32 2022] DELETE /identity/v3/users/4726882c02334bf89bc891e9fdabc6a1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:32.634561 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:32.645706 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078b7f-5a63-47a3-abdd-baefaa1cfb39 service cinder] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:32.715254 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:32.715892 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:32.716177 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:32.716456 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] PATH_INFO: `/v3/projects/4dcb796bdd4d4e5b95e2406ca84a5f96` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:32.718133 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcb796bdd4d4e5b95e2406ca84a5f96)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:32.720042 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:32.766209 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcb796bdd4d4e5b95e2406ca84a5f96', 'request_id': 'req-8e8c6924-f84d-4e01-a706-799370230480'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.773897 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcb796bdd4d4e5b95e2406ca84a5f96', 'request_id': 'req-8e8c6924-f84d-4e01-a706-799370230480'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.780659 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcb796bdd4d4e5b95e2406ca84a5f96', 'request_id': 'req-8e8c6924-f84d-4e01-a706-799370230480'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.797604 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] The token cache is being invalidate because project 4dcb796bdd4d4e5b95e2406ca84a5f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:32.797942 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.798597 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.800150 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1451/2903] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:32 2022] DELETE /identity/v3/projects/4dcb796bdd4d4e5b95e2406ca84a5f96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:32.804154 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:32.805665 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:32.822010 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947b89-ee39-419e-8274-ff6ad9cee3c8 admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:32.880578 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:32.881225 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:32.881514 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:32.881970 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] PATH_INFO: `/v3/users/c29c7d3ebe924c07989d54c9ca05bb24` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:32.883093 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29c7d3ebe924c07989d54c9ca05bb24)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:32.885026 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:32.887765 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:32.936714 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29c7d3ebe924c07989d54c9ca05bb24'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.937423 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29c7d3ebe924c07989d54c9ca05bb24'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.949371 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29c7d3ebe924c07989d54c9ca05bb24'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.950041 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29c7d3ebe924c07989d54c9ca05bb24'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.957606 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29c7d3ebe924c07989d54c9ca05bb24'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:32.970708 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1453/2904] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:32 2022] DELETE /identity/v3/users/c29c7d3ebe924c07989d54c9ca05bb24 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:33.141008 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:33.142499 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:33.155921 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c6924-f84d-4e01-a706-799370230480 admin admin] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:33.199197 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:33.216959 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:33.217595 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:33.217920 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:33.218201 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] PATH_INFO: `/v3/projects/fba96335fb174f5eaadda38e253f821d` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:33.219319 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba96335fb174f5eaadda38e253f821d)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:33.221221 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:33.268058 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba96335fb174f5eaadda38e253f821d', 'request_id': 'req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.274391 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba96335fb174f5eaadda38e253f821d', 'request_id': 'req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.279985 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba96335fb174f5eaadda38e253f821d', 'request_id': 'req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.292422 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] The token cache is being invalidate because project fba96335fb174f5eaadda38e253f821d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:33.292710 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.293346 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-8388ca1a-8def-4fcd-bf96-bdb61cce76fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.295370 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1452/2905] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:33 2022] DELETE /identity/v3/projects/fba96335fb174f5eaadda38e253f821d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:33.543457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:33.545481 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:33.559020 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ce0f3-96c2-4fce-98c1-ee164c89b29c admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:33.617253 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:33.617984 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:33.618433 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:33.618737 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] PATH_INFO: `/v3/users/a4b7e1ddbe004c77ad6f14d8af089ced` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:33.619852 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b7e1ddbe004c77ad6f14d8af089ced)` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:33.621753 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:33.670207 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b7e1ddbe004c77ad6f14d8af089ced'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.671017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b7e1ddbe004c77ad6f14d8af089ced'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.684770 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b7e1ddbe004c77ad6f14d8af089ced'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.686112 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b7e1ddbe004c77ad6f14d8af089ced'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.693938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.notifications [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b7e1ddbe004c77ad6f14d8af089ced'} {{(pid=82399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:33.703261 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:33.708390 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1454/2906] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 24 06:04:33 2022] DELETE /identity/v3/users/a4b7e1ddbe004c77ad6f14d8af089ced => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:33.713159 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] REQUEST_METHOD: `POST` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:33.713731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:33.713731 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:33.732672 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.auth.core [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] MFA Rules not processed for user `8a81889bb63444b2b7591804fdae4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:04:33.733904 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:33.791447 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1453/2907] 10.222.0.61 () {58 vars in 958 bytes} [Wed Aug 24 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:04:33.801008 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:33.802621 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:33.861703 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c33be-4628-4e7f-882d-0044e146a08b admin admin] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:33.866486 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e4d0e7360db4d7db2bfe7ef1b0c2aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:33.867123 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:33.867439 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:33.867815 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:33.877457 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:33.878938 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:33.889137 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1455/2908] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:34.157213 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] Authenticating user token {{(pid=82400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:34.158689 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.fernet_utils [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:34.171421 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2225e-1deb-4f26-a115-fb289bc175a1 None None] Validating token access rules against request {{(pid=82400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:34.176095 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a81889bb63444b2b7591804fdae4c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d992e7dad954566a305a48a7522cc33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:34.176740 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:34.177401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:34.177401 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] PATH_INFO: `/v3/projects/0117df7e7e694db89ee82058582db4db` {{(pid=82400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:34.178580 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0117df7e7e694db89ee82058582db4db)` {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:34.180724 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] RBAC: Authorization granted {{(pid=82400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:34.228416 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0117df7e7e694db89ee82058582db4db', 'request_id': 'req-418e2d4b-1c9c-489a-bd50-65de3613cdb4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:34.234515 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0117df7e7e694db89ee82058582db4db', 'request_id': 'req-418e2d4b-1c9c-489a-bd50-65de3613cdb4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:34.240316 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0117df7e7e694db89ee82058582db4db', 'request_id': 'req-418e2d4b-1c9c-489a-bd50-65de3613cdb4'} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:34.243886 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:34.255338 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] The token cache is being invalidate because project 0117df7e7e694db89ee82058582db4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:04:34.255647 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:34.256583 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG keystone.notifications [None req-418e2d4b-1c9c-489a-bd50-65de3613cdb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:04:34.258134 dv-cinder-854269-1-smb devstack@keystone.service[82400]: [pid: 82400|app: 0|req: 1454/2909] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 24 06:04:34 2022] DELETE /identity/v3/projects/0117df7e7e694db89ee82058582db4db => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:04:43.884376 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=26 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:44.257390 dv-cinder-854269-1-smb devstack@keystone.service[82400]: DEBUG dbcounter [-] [82400] Writing DB stats keystone:SELECT=2 {{(pid=82400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:43.679868 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] Authenticating user token {{(pid=82399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:05:43.681372 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:05:43.750099 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dcec9-a9da-4f0b-8fc2-1b08dfbd83c0 service neutron] Validating token access rules against request {{(pid=82399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:05:43.808919 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dccfa8372374f06b49680ed24b3020c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41615b72a6f64c26851c96fec81cc2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:05:43.809446 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] REQUEST_METHOD: `GET` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:05:43.809732 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] SCRIPT_NAME: `/identity` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:05:43.810192 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:05:43.811922 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.fernet_utils [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:05:43.823699 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:05:43.825281 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8953fe-6c11-40ab-87fb-ca862b498246 service placement] RBAC: Authorization granted {{(pid=82399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:05:43.838017 dv-cinder-854269-1-smb devstack@keystone.service[82399]: [pid: 82399|app: 0|req: 1456/2910] 10.222.0.61 () {60 vars in 1365 bytes} [Wed Aug 24 06:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:05:53.831869 dv-cinder-854269-1-smb devstack@keystone.service[82399]: DEBUG dbcounter [-] [82399] Writing DB stats keystone:SELECT=58 {{(pid=82399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}